Jul 21 18:55:43 devstack cinder-volume[76467]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 18:55:43 devstack cinder-volume[76467]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 18:55:43 devstack cinder-volume[76467]: we strongly recommend against using it for new projects. Jul 21 18:55:43 devstack cinder-volume[76467]: If you are already using Eventlet, we recommend migrating to a different Jul 21 18:55:43 devstack cinder-volume[76467]: framework. For more detail see Jul 21 18:55:43 devstack cinder-volume[76467]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 18:55:43 devstack cinder-volume[76467]: import eventlet # noqa Jul 21 18:55:46 devstack cinder-volume[76467]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 18:55:46 devstack cinder-volume[76467]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 18:55:46 devstack cinder-volume[76467]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 18:55:47 devstack cinder-volume[76467]: INFO dbcounter [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Registered counter for database cinder Jul 21 18:55:47 devstack cinder-volume[76467]: DEBUG oslo_db.sqlalchemy.engines [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76467) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:55:47 devstack cinder-volume[76467]: DEBUG dbcounter [-] [76467] Writer thread running {{(pid=76467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 18:55:47 devstack cinder-volume[76467]: INFO cinder.rpc [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 18:55:47 devstack cinder-volume[76467]: INFO cinder.rpc [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 18:55:47 devstack cinder-volume[76467]: DEBUG oslo_db.sqlalchemy.engines [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76467) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:55:47 devstack cinder-volume[76467]: INFO cinder.volume.manager [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Determined volume DB was empty at startup. Jul 21 18:55:47 devstack cinder-volume[76467]: DEBUG cinder.volume.manager [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76467) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 18:55:47 devstack cinder-volume[76467]: INFO cinder.volume.manager [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 21 18:55:47 devstack cinder-volume[76467]: WARNING stevedore.named [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 18:55:47 devstack cinder-volume[76467]: WARNING castellan.key_manager [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 18:55:47 devstack cinder-volume[76467]: WARNING cinder.keymgr.conf_key_mgr [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 18:55:47 devstack cinder-volume[76467]: DEBUG cinder.volume.drivers.lvm [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76467) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 21 18:55:47 devstack cinder-volume[76467]: DEBUG oslo_concurrency.processutils [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_concurrency.processutils [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] CMD "cinder-rtstool verify" returned: 0 in 0.496s {{(pid=76467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_db.sqlalchemy.engines [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76467) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:55:48 devstack cinder-volume[76467]: INFO cinder.rpc [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 21 18:55:48 devstack cinder-volume[76467]: INFO cinder.rpc [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 21 18:55:48 devstack cinder-volume[76467]: WARNING stevedore.named [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 18:55:48 devstack cinder-volume[76467]: WARNING castellan.key_manager [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 18:55:48 devstack cinder-volume[76467]: INFO cinder.volume.manager [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_db.sqlalchemy.engines [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76467) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:55:48 devstack cinder-volume[76467]: INFO oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Starting 1 workers Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Started child 76721 {{(pid=76467) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Full set of CONF: {{(pid=76467) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] ******************************************************************************** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Configuration options gathered from: {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] ================================================================================ {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] allow_availability_zone_fallback = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] allow_compression_on_image_upload = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] allowed_direct_url_schemes = [] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] api_rate_limit = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] auth_strategy = keystone {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] az_cache_duration = 3600 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_availability_zone = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_host = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_name = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_stats_polling_interval = 60 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backup_api_class = cinder.backup.api.API {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backup_name_template = backup-%s {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backup_use_same_host = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backup_use_temp_snapshot = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] chap_password = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] chap_username = {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cinder_internal_tenant_project_id = a3659193c2d64f83816a216fd1ebf24c {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cinder_internal_tenant_user_id = 1ad02ee838e94070938160ad4fb1ac29 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76721]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cloned_volume_same_az = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cluster = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] compression_format = gzip {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] compute_api_class = cinder.compute.nova.API {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] config_dir = [] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] config_source = [] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] control_exchange = openstack {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] debug = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] default_availability_zone = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] default_group_type = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] default_volume_type = lvmdriver-1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] disk_geometry = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] driver_client_cert = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] driver_client_cert_key = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] driver_data_namespace = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] driver_ssl_cert_path = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] driver_ssl_cert_verify = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] driver_use_ssl = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] enable_force_upload = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] enable_new_services = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] enable_unsupported_driver = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] enabled_backends = ['lvmdriver-1'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] enforce_multipath_for_image_xfer = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] filter_function = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance_api_insecure = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance_api_ssl_compression = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance_ca_certificates_file = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance_catalog_info = image:glance:publicURL {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance_certfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance_keyfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance_num_retries = 3 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance_request_timeout = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] goodness_function = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] graceful_shutdown_timeout = 5 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] group_api_class = cinder.group.api.API {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] host = devstack {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] image_compress_on_upload = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] image_conversion_address_space_limit = 1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] image_conversion_cpu_limit = 60 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] image_conversion_disable = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] image_upload_use_cinder_backend = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] image_upload_use_internal_tenant = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] image_volume_cache_enabled = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] image_volume_cache_max_count = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] image_volume_cache_max_size_gb = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] init_host_max_objects_retrieval = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] instance_format = [instance: %(uuid)s] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] iscsi_target_flags = {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] iscsi_write_cache = on {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] iser_helper = tgtadm {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] iser_ip_address = 192.168.122.213 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] iser_port = 3260 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] log_color = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] log_config_append = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] log_dir = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] log_file = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] log_options = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] log_rotate_interval = 1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] log_rotate_interval_type = days {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] log_rotation_type = none {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] max_age = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] max_logfile_count = 30 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] max_logfile_size_mb = 200 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] max_over_subscription_ratio = 20.0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] message_reap_interval = 86400 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] message_ttl = 2592000 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] migration_create_volume_timeout_secs = 300 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] monkey_patch = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] monkey_patch_modules = [] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] my_ip = 192.168.122.213 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] no_snapshot_gb_quota = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] num_iser_scan_tries = 3 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] num_shell_tries = 3 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] num_volume_device_scan_tries = 3 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] nvmeof_conn_info_version = 1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] nvmet_ns_id = 10 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] nvmet_port_id = 1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] osapi_max_limit = 1000 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] osapi_volume_ext_list = [] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] osapi_volume_listen = 0.0.0.0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] osapi_volume_listen_port = 8776 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] osapi_volume_use_ssl = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] osapi_volume_workers = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] per_volume_size_limit = -1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] periodic_fuzzy_delay = 60 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] periodic_interval = 60 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] project_id_regex = [0-9a-f\-]+ {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] public_endpoint = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] publish_errors = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] quota_backup_gigabytes = 1000 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] quota_backups = 10 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] quota_gigabytes = 1000 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] quota_groups = 10 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] quota_snapshots = 10 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] quota_volumes = 10 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] rate_limit_burst = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] rate_limit_except_level = CRITICAL {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] rate_limit_interval = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] reinit_driver_count = 3 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] replication_device = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] report_discard_supported = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] report_interval = 120 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] reservation_clean_interval = 86400 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] reservation_expire = 86400 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] reserved_image_namespaces = [] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] reserved_percentage = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76721]: INFO cinder.volume.manager [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] rpc_response_timeout = 120 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] run_external_periodic_tasks = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] scst_target_driver = iscsi {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] scst_target_iqn_name = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] service_down_time = 720 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] shell_completion = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] snapshot_name_template = snapshot-%s {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] snapshot_same_host = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] split_loggers = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] state_path = /opt/stack/data/cinder {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] storage_availability_zone = nova {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] storage_protocol = iSCSI {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] syslog_log_facility = LOG_USER {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] target_helper = lioadm {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] target_ip_address = 192.168.122.213 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] target_port = 3260 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] target_protocol = iscsi {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] target_secondary_ip_addresses = [] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] trace_flags = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] transfer_api_class = cinder.transfer.api.API {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] transport_url = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] until_refresh = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] use_chap_auth = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] use_default_quota_class = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] use_journal = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] use_json = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] use_multipath_for_image_xfer = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] use_stderr = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] use_syslog = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] verify_glance_signatures = enabled {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] volume_api_class = cinder.volume.api.API {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] volume_backend_name = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] volume_clear = zero {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] volume_clear_ionice = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] volume_clear_size = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] volume_copy_bps_limit = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] volume_dd_blocksize = 1M {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] volume_name_template = volume-%s {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] volume_service_inithost_offload = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] volume_usage_audit_period = month {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] zoning_mode = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_concurrency.disable_process_locking = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.auth_section = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.auth_type = password {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.auth_version = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.cache = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.certfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.delay_auth_decision = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.http_connect_timeout = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.include_service_catalog = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.insecure = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.interface = public {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.keyfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_password = {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcache_username = {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.region_name = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.service_token_roles_required = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.service_type = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.token_cache_time = 300 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.backend = dogpile.cache.null {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.backend_argument = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.backend_expiration_time = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.config_prefix = cache.oslo {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.debug_cache_backend = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.enable_retry_client = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.enable_socket_keepalive = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.enabled = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.expiration_time = 600 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.hashclient_retry_attempts = 2 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.memcache_dead_retry = 300 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.memcache_pool_maxsize = 10 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.memcache_sasl_enabled = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.password = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.proxies = [] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.redis_db = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.redis_sentinel_service_name = mymaster {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.redis_server = localhost:6379 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.retry_attempts = 2 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.retry_delay = 0.0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.socket_keepalive_count = 1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.socket_keepalive_idle = 1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.socket_keepalive_interval = 1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.socket_timeout = 1.0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.tls_allowed_ciphers = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.tls_cafile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.tls_certfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.tls_enabled = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.tls_keyfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cache.username = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] coordination.backend_url = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.asyncio_connection = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.asyncio_slave_connection = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.backend = sqlalchemy {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.connection = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.connection_debug = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.connection_parameters = {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.connection_recycle_time = 3600 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.connection_trace = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.db_inc_retry_interval = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.db_max_retries = 20 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.db_max_retry_interval = 10 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.db_retry_interval = 1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.max_overflow = 50 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.max_pool_size = 5 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.max_retries = 10 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.mysql_wsrep_sync_wait = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.pool_timeout = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.retry_interval = 10 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.slave_connection = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.sqlite_synchronous = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.synchronous_reader = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] database.use_db_reconnect = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] profiler.connection_string = messaging:// {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] profiler.enabled = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] profiler.es_doc_type = notification {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] profiler.es_scroll_size = 10000 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] profiler.es_scroll_time = 2m {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] profiler.filter_error_trace = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] profiler.hmac_keys = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] profiler.sentinel_service_name = mymaster {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] profiler.socket_timeout = 0.1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] profiler.trace_requests = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] profiler.trace_sqlalchemy = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] profiler_jaeger.process_tags = {} {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] profiler_jaeger.service_name_prefix = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] profiler_otlp.service_name_prefix = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_policy.enforce_new_defaults = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_policy.policy_default_rule = default {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_policy.policy_file = policy.yaml {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_policy.remote_timeout = 60.0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] privsep_osbrick.group = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] privsep_osbrick.helper_command = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] privsep_osbrick.user = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cinder_sys_admin.group = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cinder_sys_admin.helper_command = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] cinder_sys_admin.user = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] service_user.auth_section = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] service_user.auth_type = password {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] service_user.cafile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] service_user.certfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] service_user.collect_timing = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] service_user.insecure = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] service_user.keyfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] service_user.send_service_user_token = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] service_user.split_loggers = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] service_user.timeout = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance.auth_section = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance.auth_type = password {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance.certfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance.collect_timing = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance.insecure = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance.keyfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance.region_name = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance.split_loggers = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] glance.timeout = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.backend_availability_zone = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.chap_password = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.chap_username = {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.disk_geometry = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.driver_client_cert = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.driver_client_cert_key = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.driver_data_namespace = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.driver_use_ssl = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.enable_unsupported_driver = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.extra_capabilities = {} {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.filter_function = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.goodness_function = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.iscsi_target_flags = {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.iscsi_write_cache = on {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.iser_helper = tgtadm {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.iser_port = 3260 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.lvm_mirrors = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.lvm_share_target = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.lvm_type = auto {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.num_shell_tries = 3 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.nvmet_port_id = 1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.replication_device = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.report_discard_supported = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.reserved_percentage = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.scst_target_driver = iscsi {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.scst_target_iqn_name = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.storage_protocol = iSCSI {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack sudo[76778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.target_helper = tgtadm {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.target_port = 3260 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.target_protocol = iscsi {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack sudo[76778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.trace_flags = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.unique_fqdn_network = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.use_chap_auth = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.volume_backend_name = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.volume_clear = zero {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.volume_clear_ionice = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.volume_clear_size = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.volume_group = cinder-volumes {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_reports.file_event_handler = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_reports.log_dir = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.backend_availability_zone = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.backend_host = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.chap_password = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.chap_username = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.chiscsi_conf = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.disk_geometry = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.driver_client_cert = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.driver_data_namespace = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.driver_use_ssl = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.extra_capabilities = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.filter_function = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.goodness_function = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.iser_helper = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.iser_ip_address = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.iser_port = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.iser_target_prefix = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.lvm_conf_file = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.lvm_mirrors = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.lvm_share_target = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.lvm_type = auto {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.num_shell_tries = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.nvmet_port_id = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.replication_device = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.report_discard_supported = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.reserved_percentage = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.scst_target_driver = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.storage_protocol = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.target_helper = lioadm {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.target_ip_address = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.target_port = 3260 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.target_protocol = iscsi {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.trace_flags = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.use_chap_auth = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.volume_clear = zero {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.volume_clear_size = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] lvmdriver-1.volumes_dir = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.ssl = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.ssl_version = {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_notifications.driver = [] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_notifications.retry = -1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] oslo_messaging_notifications.transport_url = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] key_manager.fixed_key = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.barbican_api_version = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.barbican_endpoint = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.barbican_endpoint_type = public {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.barbican_region_name = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.cafile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.certfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.collect_timing = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.insecure = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.keyfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.number_of_retries = 60 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.retry_delay = 1 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.send_service_user_token = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.split_loggers = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.timeout = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.verify_ssl = True {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican.verify_ssl_path = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican_service_user.auth_section = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican_service_user.auth_type = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican_service_user.cafile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican_service_user.certfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican_service_user.collect_timing = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican_service_user.insecure = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican_service_user.keyfile = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican_service_user.split_loggers = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] barbican_service_user.timeout = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.approle_role_id = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.approle_secret_id = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.auth_method = approle {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.auth_path = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.kv_mountpoint = secret {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.kv_path = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.kv_version = 2 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.namespace = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.root_token_id = **** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.ssl_ca_crt_file = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.timeout = 60.0 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.token_file = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.token_role = None {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.use_ssl = False {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:55:48 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] ******************************************************************************** {{(pid=76467) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 18:55:49 devstack sudo[76778]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:49 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:49 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:49 devstack sudo[76868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:55:49 devstack sudo[76868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:49 devstack sudo[76868]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:49 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.253s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:49 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 18:55:49 devstack cinder-volume[76721]: INFO cinder.brick.local_dev.lvm [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 21 18:55:49 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:49 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:49 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:49 devstack sudo[76958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:55:49 devstack sudo[76958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:49 devstack sudo[76958]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:49 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:49 devstack cinder-volume[76721]: DEBUG cinder.brick.local_dev.lvm [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76721) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 21 18:55:49 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:49 devstack sudo[77042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:55:49 devstack sudo[77042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:51 devstack sudo[77042]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:51 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.509s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:51 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:51 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:51 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:51 devstack sudo[77353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:55:51 devstack sudo[77353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:51 devstack sudo[77353]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:51 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.379s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:51 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:51 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:51 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:51 devstack sudo[77428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 21 18:55:51 devstack sudo[77428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:51 devstack sudo[77428]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:51 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.250s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:51 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:51 devstack sudo[77431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:55:51 devstack sudo[77431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:52 devstack sudo[77431]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:52 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:52 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:52 devstack sudo[77440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:55:52 devstack sudo[77440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:52 devstack sudo[77440]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:52 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:52 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:52 devstack sudo[77443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:55:52 devstack sudo[77443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:52 devstack sudo[77443]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:52 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:52 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:52 devstack sudo[77446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:55:52 devstack sudo[77446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:52 devstack sudo[77446]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:52 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:52 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:52 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:52 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:52 devstack sudo[77450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:55:52 devstack sudo[77450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:53 devstack sudo[77450]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:53 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:53 devstack cinder-volume[76721]: INFO cinder.volume.drivers.lvm [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 21 18:55:53 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:53 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:53 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:53 devstack sudo[77454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:55:53 devstack sudo[77454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:53 devstack sudo[77454]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:53 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:53 devstack cinder-volume[76721]: DEBUG cinder.volume.drivers.lvm [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Updating volume stats {{(pid=76721) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:55:53 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:53 devstack sudo[77457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:55:53 devstack sudo[77457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:53 devstack sudo[77457]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:53 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:53 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:53 devstack sudo[77463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:55:53 devstack sudo[77463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:53 devstack sudo[77463]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:53 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:53 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:53 devstack sudo[77467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:55:53 devstack sudo[77467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:54 devstack sudo[77467]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:54 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:54 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:54 devstack sudo[77470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:55:54 devstack sudo[77470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:54 devstack sudo[77470]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:54 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:54 devstack cinder-volume[76721]: INFO cinder.volume.driver [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Driver hasn't implemented _init_vendor_properties() Jul 21 18:55:54 devstack cinder-volume[76721]: DEBUG cinder.volume.driver [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76721) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 18:55:54 devstack cinder-volume[76721]: DEBUG oslo_db.sqlalchemy.engines [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76721) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:55:54 devstack cinder-volume[76721]: DEBUG dbcounter [-] [76721] Writer thread running {{(pid=76721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 18:55:54 devstack cinder-volume[76721]: DEBUG cinder.db.api [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Building query based on filter {{(pid=76721) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 18:55:54 devstack cinder-volume[76721]: DEBUG cinder.image.image_utils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76721) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 18:55:54 devstack cinder-volume[76721]: INFO cinder.keymgr.migration [None req-4292cc94-6669-454e-916b-07ac91e300f4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 18:55:54 devstack cinder-volume[76721]: DEBUG cinder.volume.drivers.lvm [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Updating volume stats {{(pid=76721) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:55:54 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:54 devstack sudo[77475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:55:54 devstack sudo[77475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:54 devstack sudo[77475]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:54 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:54 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:54 devstack sudo[77478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:55:54 devstack sudo[77478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:55 devstack sudo[77478]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:55 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:55 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:55 devstack sudo[77481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:55:55 devstack sudo[77481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:55 devstack sudo[77481]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:55 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:55 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:55 devstack sudo[77487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:55:55 devstack sudo[77487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:55 devstack sudo[77487]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:55 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:55 devstack cinder-volume[76721]: DEBUG cinder.manager [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Notifying Schedulers of capabilities ... {{(pid=76721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 18:55:55 devstack cinder-volume[76721]: INFO cinder.volume.manager [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Driver initialization completed successfully. Jul 21 18:55:55 devstack cinder-volume[76721]: INFO cinder.manager [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Initiating service 2 cleanup Jul 21 18:55:55 devstack cinder-volume[76721]: INFO cinder.manager [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Service 2 cleanup completed. Jul 21 18:55:55 devstack cinder-volume[76721]: DEBUG cinder.service [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Creating RPC server for service cinder-volume {{(pid=76721) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 18:55:55 devstack cinder-volume[76721]: DEBUG cinder.service [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76721) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 18:55:55 devstack cinder-volume[76721]: INFO cinder.volume.manager [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 21 18:55:55 devstack cinder-volume[76721]: DEBUG cinder.volume.drivers.lvm [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Updating volume stats {{(pid=76721) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:55:55 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:55 devstack sudo[77491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:55:55 devstack sudo[77491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:56 devstack sudo[77491]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:56 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:56 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:56 devstack sudo[77498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:55:56 devstack sudo[77498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:56 devstack sudo[77498]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:56 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:56 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:56 devstack sudo[77503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:55:56 devstack sudo[77503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:56 devstack sudo[77503]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:56 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.314s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:56 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:56 devstack sudo[77588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:55:56 devstack sudo[77588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:57 devstack sudo[77588]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:57 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:57 devstack cinder-volume[76721]: INFO cinder.volume.manager [None req-b93d08b7-3081-4df2-9aab-f958ef1fa2db None None] Driver post RPC initialization completed successfully. Jul 21 18:55:58 devstack cinder-volume[76467]: DEBUG dbcounter [-] [76467] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:56:05 devstack cinder-volume[76721]: DEBUG dbcounter [-] [76721] Writing DB stats cinder:SELECT=3 {{(pid=76721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:56:07 devstack cinder-volume[76721]: DEBUG dbcounter [-] [76721] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:56:08 devstack cinder-volume[76721]: DEBUG oslo_service.periodic_task [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running periodic task VolumeManager._thread_info {{(pid=76721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:56:08 devstack cinder-volume[76721]: DEBUG cinder.volume.manager [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] thread count: 6 {{(pid=76721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 18:56:08 devstack cinder-volume[76721]: DEBUG cinder.volume.manager [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] thread info: [<_MainThread(MainThread, started 134016268271744)>, , , , , ] {{(pid=76721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 18:57:08 devstack cinder-volume[76721]: DEBUG oslo_service.periodic_task [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:57:08 devstack cinder-volume[76721]: DEBUG cinder.volume.drivers.lvm [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Updating volume stats {{(pid=76721) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:57:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:57:08 devstack sudo[79735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:57:08 devstack sudo[79735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:57:08 devstack sudo[79735]: pam_unix(sudo:session): session closed for user root Jul 21 18:57:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:57:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:57:08 devstack sudo[79738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:57:08 devstack sudo[79738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:57:08 devstack sudo[79738]: pam_unix(sudo:session): session closed for user root Jul 21 18:57:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:57:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:57:08 devstack sudo[79851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:57:08 devstack sudo[79851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:57:08 devstack sudo[79851]: pam_unix(sudo:session): session closed for user root Jul 21 18:57:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:57:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:57:08 devstack sudo[79854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:57:08 devstack sudo[79854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:57:09 devstack sudo[79854]: pam_unix(sudo:session): session closed for user root Jul 21 18:57:09 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:57:09 devstack cinder-volume[76721]: DEBUG cinder.manager [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Notifying Schedulers of capabilities ... {{(pid=76721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 18:57:09 devstack cinder-volume[76721]: DEBUG oslo_service.periodic_task [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running periodic task VolumeManager._thread_info {{(pid=76721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:57:09 devstack cinder-volume[76721]: DEBUG cinder.volume.manager [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] thread count: 6 {{(pid=76721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 18:57:09 devstack cinder-volume[76721]: DEBUG cinder.volume.manager [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] thread info: [<_MainThread(MainThread, started 134016268271744)>, , , , , ] {{(pid=76721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 18:58:07 devstack cinder-volume[76721]: DEBUG dbcounter [-] [76721] Writing DB stats cinder:SELECT=1 {{(pid=76721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:58:07 devstack cinder-volume[76721]: DEBUG dbcounter [-] [76721] Writing DB stats cinder:UPDATE=1 {{(pid=76721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:58:08 devstack cinder-volume[76721]: DEBUG oslo_service.periodic_task [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:58:08 devstack cinder-volume[76721]: DEBUG cinder.volume.drivers.lvm [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Updating volume stats {{(pid=76721) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:58:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:58:08 devstack sudo[83056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:58:08 devstack sudo[83056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:58:08 devstack sudo[83056]: pam_unix(sudo:session): session closed for user root Jul 21 18:58:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:58:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:58:08 devstack sudo[83060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:58:08 devstack sudo[83060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:58:08 devstack sudo[83060]: pam_unix(sudo:session): session closed for user root Jul 21 18:58:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:58:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:58:08 devstack sudo[83063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:58:08 devstack sudo[83063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:58:08 devstack sudo[83063]: pam_unix(sudo:session): session closed for user root Jul 21 18:58:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:58:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:58:08 devstack sudo[83082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:58:08 devstack sudo[83082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:58:09 devstack sudo[83082]: pam_unix(sudo:session): session closed for user root Jul 21 18:58:09 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:58:09 devstack cinder-volume[76721]: DEBUG cinder.manager [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Notifying Schedulers of capabilities ... {{(pid=76721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 18:58:09 devstack cinder-volume[76721]: DEBUG oslo_service.periodic_task [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running periodic task VolumeManager._thread_info {{(pid=76721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:58:09 devstack cinder-volume[76721]: DEBUG cinder.volume.manager [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] thread count: 6 {{(pid=76721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 18:58:09 devstack cinder-volume[76721]: DEBUG cinder.volume.manager [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] thread info: [<_MainThread(MainThread, started 134016268271744)>, , , , , ] {{(pid=76721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 18:59:08 devstack cinder-volume[76721]: DEBUG oslo_service.periodic_task [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:59:08 devstack cinder-volume[76721]: DEBUG cinder.volume.drivers.lvm [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Updating volume stats {{(pid=76721) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:59:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:08 devstack sudo[85079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:59:08 devstack sudo[85079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:08 devstack sudo[85079]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:08 devstack sudo[85082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:59:08 devstack sudo[85082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:08 devstack sudo[85082]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:08 devstack sudo[85099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:59:08 devstack sudo[85099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:08 devstack sudo[85099]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.307s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:08 devstack sudo[85110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:59:08 devstack sudo[85110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:09 devstack sudo[85110]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:09 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:09 devstack cinder-volume[76721]: DEBUG cinder.manager [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Notifying Schedulers of capabilities ... {{(pid=76721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:00:07 devstack cinder-volume[76721]: DEBUG dbcounter [-] [76721] Writing DB stats cinder:SELECT=1 {{(pid=76721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:00:07 devstack cinder-volume[76721]: DEBUG dbcounter [-] [76721] Writing DB stats cinder:UPDATE=1 {{(pid=76721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:00:08 devstack cinder-volume[76721]: DEBUG oslo_service.periodic_task [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:00:08 devstack cinder-volume[76721]: DEBUG cinder.volume.drivers.lvm [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Updating volume stats {{(pid=76721) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 19:00:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:08 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 19:00:08 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:08 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:08 devstack sudo[86334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 19:00:08 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:08 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:08 devstack sudo[86337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 19:00:08 devstack sudo[86337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:08 devstack sudo[86337]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:08 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:08 devstack sudo[86351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 19:00:08 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:09 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:09 devstack cinder-volume[76721]: DEBUG oslo_concurrency.processutils [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:09 devstack cinder-volume[76721]: DEBUG cinder.manager [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Notifying Schedulers of capabilities ... {{(pid=76721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:00:09 devstack cinder-volume[76721]: DEBUG oslo_service.periodic_task [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] Running periodic task VolumeManager._thread_info {{(pid=76721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:00:09 devstack cinder-volume[76721]: DEBUG cinder.volume.manager [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] thread count: 6 {{(pid=76721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:00:09 devstack cinder-volume[76721]: DEBUG cinder.volume.manager [None req-3b8c3106-7dd5-4d45-9319-e94c05405132 None None] thread info: [<_MainThread(MainThread, started 134016268271744)>, , , , , ] {{(pid=76721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:00:20 devstack cinder-volume[76467]: INFO oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Caught SIGTERM, stopping children Jul 21 19:00:20 devstack cinder-volume[76467]: DEBUG oslo_concurrency.lockutils [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Acquiring lock "singleton_lock" {{(pid=76467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 19:00:20 devstack cinder-volume[76467]: DEBUG oslo_concurrency.lockutils [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Acquired lock "singleton_lock" {{(pid=76467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 19:00:20 devstack cinder-volume[76467]: DEBUG oslo_concurrency.lockutils [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Releasing lock "singleton_lock" {{(pid=76467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 19:00:20 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Stop services. {{(pid=76467) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 21 19:00:20 devstack cinder-volume[76467]: DEBUG oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Killing children. {{(pid=76467) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 21 19:00:20 devstack cinder-volume[76467]: INFO oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Waiting on 1 children to exit Jul 21 19:00:20 devstack cinder-volume[76721]: DEBUG oslo_concurrency.lockutils [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Acquiring lock "singleton_lock" {{(pid=76721) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 19:00:20 devstack cinder-volume[76721]: DEBUG oslo_concurrency.lockutils [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Acquired lock "singleton_lock" {{(pid=76721) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 19:00:20 devstack cinder-volume[76721]: DEBUG oslo_concurrency.lockutils [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Releasing lock "singleton_lock" {{(pid=76721) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 19:00:20 devstack cinder-volume[76721]: WARNING amqp [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 19:00:20 devstack cinder-volume[76721]: WARNING amqp [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 19:00:20 devstack cinder-volume[76467]: INFO oslo_service.backend._eventlet.service [None req-f9733461-2c9a-4cfd-b985-65d14c22727e None None] Child 76721 exited with status 0 Jul 21 19:00:21 devstack cinder-volume[86731]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 19:00:21 devstack cinder-volume[86731]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 19:00:21 devstack cinder-volume[86731]: we strongly recommend against using it for new projects. Jul 21 19:00:21 devstack cinder-volume[86731]: If you are already using Eventlet, we recommend migrating to a different Jul 21 19:00:21 devstack cinder-volume[86731]: framework. For more detail see Jul 21 19:00:21 devstack cinder-volume[86731]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 19:00:21 devstack cinder-volume[86731]: import eventlet # noqa Jul 21 19:00:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 19:00:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 19:00:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 19:00:24 devstack cinder-volume[86731]: INFO dbcounter [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Registered counter for database cinder Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_db.sqlalchemy.engines [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writer thread running {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 19:00:24 devstack cinder-volume[86731]: INFO cinder.rpc [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 19:00:24 devstack cinder-volume[86731]: INFO cinder.rpc [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_db.sqlalchemy.engines [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:00:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Determined volume DB was empty at startup. Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86731) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 19:00:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 21 19:00:24 devstack cinder-volume[86731]: WARNING stevedore.named [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 19:00:24 devstack cinder-volume[86731]: WARNING castellan.key_manager [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 19:00:24 devstack cinder-volume[86731]: WARNING cinder.keymgr.conf_key_mgr [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 19:00:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_db.sqlalchemy.engines [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:00:24 devstack cinder-volume[86731]: INFO oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Starting 1 workers Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Started child 86945 {{(pid=86731) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Full set of CONF: {{(pid=86731) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] ******************************************************************************** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Configuration options gathered from: {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 19:00:24 devstack cinder-volume[86945]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] ================================================================================ {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] allow_availability_zone_fallback = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] allow_compression_on_image_upload = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] allowed_direct_url_schemes = [] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] api_rate_limit = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] auth_strategy = keystone {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_availability_zone = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_host = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_name = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_stats_polling_interval = 60 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backup_api_class = cinder.backup.api.API {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backup_name_template = backup-%s {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backup_use_same_host = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backup_use_temp_snapshot = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] chap_password = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] chap_username = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cinder_internal_tenant_project_id = a3659193c2d64f83816a216fd1ebf24c {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cinder_internal_tenant_user_id = 1ad02ee838e94070938160ad4fb1ac29 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cluster = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] compression_format = gzip {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] compute_api_class = cinder.compute.nova.API {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] config_dir = [] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] config_source = [] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] control_exchange = openstack {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] debug = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] default_availability_zone = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] default_group_type = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] default_volume_type = QuobyteHD {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] disk_geometry = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] driver_client_cert = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] driver_client_cert_key = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] driver_data_namespace = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] driver_ssl_cert_path = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] driver_ssl_cert_verify = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] driver_use_ssl = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] enable_new_services = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] enable_unsupported_driver = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] enabled_backends = ['QuobyteHD'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] enforce_multipath_for_image_xfer = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] filter_function = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance_api_insecure = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance_api_ssl_compression = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance_ca_certificates_file = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance_catalog_info = image:glance:publicURL {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance_certfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance_keyfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance_num_retries = 3 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance_request_timeout = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] goodness_function = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] graceful_shutdown_timeout = 5 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] group_api_class = cinder.group.api.API {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] host = devstack {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] image_compress_on_upload = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] image_conversion_address_space_limit = 1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] image_conversion_cpu_limit = 60 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] image_conversion_disable = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] image_upload_use_cinder_backend = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] image_upload_use_internal_tenant = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] image_volume_cache_enabled = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] image_volume_cache_max_count = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] image_volume_cache_max_size_gb = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] init_host_max_objects_retrieval = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] instance_format = [instance: %(uuid)s] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] iscsi_target_flags = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] iscsi_write_cache = on {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] iser_helper = tgtadm {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] iser_ip_address = 192.168.122.213 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] iser_port = 3260 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] log_color = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] log_config_append = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] log_dir = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] log_file = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] log_options = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] log_rotate_interval = 1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] log_rotate_interval_type = days {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] log_rotation_type = none {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86945]: INFO cinder.volume.manager [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Starting volume driver QuobyteDriver (1.2) Jul 21 19:00:24 devstack cinder-volume[86945]: DEBUG cinder.volume.drivers.remotefs [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86945) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] max_age = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] max_logfile_count = 30 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] max_logfile_size_mb = 200 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] max_over_subscription_ratio = 20.0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] message_reap_interval = 86400 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] message_ttl = 2592000 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] migration_create_volume_timeout_secs = 300 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] monkey_patch = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] monkey_patch_modules = [] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] my_ip = 192.168.122.213 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] no_snapshot_gb_quota = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] num_iser_scan_tries = 3 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] num_shell_tries = 3 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] num_volume_device_scan_tries = 3 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] nvmeof_conn_info_version = 1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] nvmet_ns_id = 10 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] nvmet_port_id = 1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] osapi_max_limit = 1000 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] osapi_volume_ext_list = [] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] osapi_volume_listen = 0.0.0.0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] osapi_volume_listen_port = 8776 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] osapi_volume_use_ssl = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] osapi_volume_workers = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] per_volume_size_limit = -1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] periodic_fuzzy_delay = 60 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] periodic_interval = 60 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] project_id_regex = [0-9a-f\-]+ {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] public_endpoint = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] publish_errors = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] quota_backup_gigabytes = 1000 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] quota_backups = 10 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] quota_gigabytes = 1000 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] quota_groups = 10 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] quota_snapshots = 10 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] quota_volumes = 10 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] rate_limit_burst = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] rate_limit_except_level = CRITICAL {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] rate_limit_interval = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] reinit_driver_count = 3 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] replication_device = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] report_discard_supported = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] report_interval = 120 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] reservation_clean_interval = 86400 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] reservation_expire = 86400 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] reserved_image_namespaces = [] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] reserved_percentage = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] rpc_response_timeout = 120 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] run_external_periodic_tasks = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] scst_target_driver = iscsi {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] scst_target_iqn_name = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] service_down_time = 720 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] shell_completion = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] snapshot_name_template = snapshot-%s {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] split_loggers = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] state_path = /opt/stack/data/cinder {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] storage_availability_zone = nova {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] storage_protocol = iSCSI {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] syslog_log_facility = LOG_USER {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] target_helper = lioadm {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] target_ip_address = 192.168.122.213 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] target_port = 3260 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] target_protocol = iscsi {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] target_secondary_ip_addresses = [] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] trace_flags = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] transfer_api_class = cinder.transfer.api.API {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] transport_url = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] until_refresh = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] use_chap_auth = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] use_default_quota_class = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] use_journal = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] use_json = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] use_multipath_for_image_xfer = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] use_stderr = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] use_syslog = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] verify_glance_signatures = enabled {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] volume_api_class = cinder.volume.api.API {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] volume_backend_name = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] volume_clear = zero {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] volume_clear_ionice = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] volume_clear_size = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] volume_copy_bps_limit = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] volume_dd_blocksize = 1M {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] volume_name_template = volume-%s {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] volume_service_inithost_offload = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] volume_usage_audit_period = month {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] zoning_mode = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_concurrency.disable_process_locking = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.auth_section = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.auth_type = password {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.auth_version = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.cache = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.certfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.delay_auth_decision = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.http_connect_timeout = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.include_service_catalog = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.insecure = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.interface = public {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.keyfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_password = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcache_username = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.region_name = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.service_token_roles_required = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.service_type = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.token_cache_time = 300 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.backend = dogpile.cache.null {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.backend_argument = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.backend_expiration_time = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.config_prefix = cache.oslo {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.debug_cache_backend = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.enable_retry_client = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.enable_socket_keepalive = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.enabled = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.expiration_time = 600 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.hashclient_retry_attempts = 2 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.memcache_dead_retry = 300 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.memcache_pool_maxsize = 10 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.memcache_sasl_enabled = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86945]: DEBUG cinder.volume.drivers.quobyte [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86945) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 21 19:00:24 devstack cinder-volume[86945]: WARNING cinder.volume.drivers.quobyte [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 21 19:00:24 devstack cinder-volume[86945]: WARNING cinder.volume.drivers.quobyte [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.password = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.proxies = [] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.redis_db = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.redis_sentinel_service_name = mymaster {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.redis_server = localhost:6379 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.retry_attempts = 2 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.retry_delay = 0.0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.socket_keepalive_count = 1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.socket_keepalive_idle = 1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.socket_keepalive_interval = 1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.socket_timeout = 1.0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.tls_allowed_ciphers = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.tls_cafile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86945]: DEBUG oslo_concurrency.processutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Running cmd (subprocess): mount.quobyte {{(pid=86945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.tls_certfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.tls_enabled = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.tls_keyfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cache.username = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] coordination.backend_url = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.asyncio_connection = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.asyncio_slave_connection = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.backend = sqlalchemy {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.connection = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.connection_debug = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.connection_parameters = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.connection_recycle_time = 3600 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.connection_trace = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.db_inc_retry_interval = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.db_max_retries = 20 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.db_max_retry_interval = 10 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.db_retry_interval = 1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.max_overflow = 50 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.max_pool_size = 5 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.max_retries = 10 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.mysql_wsrep_sync_wait = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.pool_timeout = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.retry_interval = 10 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.slave_connection = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.sqlite_synchronous = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.synchronous_reader = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] database.use_db_reconnect = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] profiler.connection_string = messaging:// {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] profiler.enabled = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] profiler.es_doc_type = notification {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] profiler.es_scroll_size = 10000 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] profiler.es_scroll_time = 2m {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] profiler.filter_error_trace = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] profiler.hmac_keys = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] profiler.sentinel_service_name = mymaster {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] profiler.socket_timeout = 0.1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] profiler.trace_requests = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] profiler.trace_sqlalchemy = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] profiler_jaeger.process_tags = {} {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] profiler_jaeger.service_name_prefix = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] profiler_otlp.service_name_prefix = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_policy.enforce_new_defaults = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_policy.policy_default_rule = default {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_policy.policy_file = policy.yaml {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_policy.remote_timeout = 60.0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] privsep_osbrick.group = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] privsep_osbrick.helper_command = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] privsep_osbrick.user = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cinder_sys_admin.group = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cinder_sys_admin.helper_command = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] cinder_sys_admin.user = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] service_user.auth_section = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] service_user.auth_type = password {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] service_user.cafile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] service_user.certfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] service_user.collect_timing = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] service_user.insecure = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] service_user.keyfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] service_user.send_service_user_token = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] service_user.split_loggers = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] service_user.timeout = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance.auth_section = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance.auth_type = password {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance.certfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance.collect_timing = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance.insecure = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance.keyfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance.region_name = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance.split_loggers = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] glance.timeout = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.backend_availability_zone = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:24 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.chap_password = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.chap_username = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.disk_geometry = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.driver_client_cert = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.driver_client_cert_key = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.driver_data_namespace = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.driver_use_ssl = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.enable_unsupported_driver = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.extra_capabilities = {} {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.filter_function = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.goodness_function = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.iscsi_target_flags = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.iscsi_write_cache = on {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.iser_helper = tgtadm {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.iser_port = 3260 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.nas_host = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.nas_login = admin {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.nas_mount_options = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.nas_password = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.nas_private_key = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.nas_share_path = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.nas_ssh_port = 22 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.num_shell_tries = 3 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG oslo_concurrency.processutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=86945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.nvmet_port_id = 1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.quobyte_client_cfg = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.quobyte_volume_url = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.replication_device = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG cinder.volume.drivers.quobyte [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=86945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.report_discard_supported = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.reserved_percentage = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.scst_target_driver = iscsi {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.scst_target_iqn_name = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86945]: INFO cinder.volume.drivers.quobyte [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 ... Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.storage_protocol = iSCSI {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG oslo_concurrency.processutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd -c /etc/quobyte/client-cinder.cfg {{(pid=86945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.target_helper = tgtadm {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.target_port = 3260 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.target_protocol = iscsi {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.trace_flags = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.unique_fqdn_network = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.use_chap_auth = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.volume_backend_name = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.volume_clear = zero {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.volume_clear_ionice = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.volume_clear_size = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_reports.file_event_handler = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_reports.log_dir = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.backend_availability_zone = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.backend_host = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.chap_password = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.chap_username = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.chiscsi_conf = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.disk_geometry = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.driver_client_cert = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.driver_client_cert_key = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.driver_data_namespace = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.driver_use_ssl = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.extra_capabilities = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.filter_function = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.goodness_function = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.iscsi_target_flags = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.iscsi_write_cache = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.iser_helper = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.iser_ip_address = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.iser_port = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.iser_target_prefix = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.nas_host = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.nas_login = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.nas_mount_options = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.nas_password = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.nas_private_key = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.nas_share_path = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.nas_ssh_port = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.num_shell_tries = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.nvmet_ns_id = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.nvmet_port_id = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.replication_device = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.report_discard_supported = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.reserved_percentage = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.scst_target_driver = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.storage_protocol = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.target_helper = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.target_ip_address = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.target_port = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.target_prefix = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.target_protocol = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack sudo[86947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd -c /etc/quobyte/client-cinder.cfg Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.trace_flags = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.unique_fqdn_network = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.use_chap_auth = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.volume_clear = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.volume_clear_ionice = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.volume_clear_size = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] QuobyteHD.volumes_dir = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.ssl = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.ssl_version = {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_notifications.driver = [] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_notifications.retry = -1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] oslo_messaging_notifications.transport_url = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] key_manager.fixed_key = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.barbican_api_version = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.barbican_endpoint = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.barbican_endpoint_type = public {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.barbican_region_name = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.cafile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.certfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.collect_timing = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.insecure = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.keyfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.number_of_retries = 60 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.retry_delay = 1 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.send_service_user_token = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.split_loggers = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.timeout = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.verify_ssl = True {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican.verify_ssl_path = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican_service_user.auth_section = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican_service_user.auth_type = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican_service_user.cafile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican_service_user.certfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican_service_user.collect_timing = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican_service_user.insecure = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican_service_user.keyfile = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican_service_user.split_loggers = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] barbican_service_user.timeout = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.approle_role_id = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.approle_secret_id = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.auth_method = approle {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.auth_path = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.kv_mountpoint = secret {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.kv_path = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.kv_version = 2 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.namespace = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.root_token_id = **** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.ssl_ca_crt_file = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.timeout = 60.0 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.token_file = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.token_role = None {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.use_ssl = False {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:25 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] ******************************************************************************** {{(pid=86731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 19:00:25 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG oslo_concurrency.processutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.437s {{(pid=86945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:25 devstack cinder-volume[86945]: INFO cinder.volume.drivers.quobyte [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 succeeded Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG cinder.volume.drivers.quobyte [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=86945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.450s {{(pid=86945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG oslo_concurrency.processutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=86945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:25 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:00:25 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:25 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG oslo_concurrency.processutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.242s {{(pid=86945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:25 devstack cinder-volume[86945]: INFO cinder.volume.driver [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Driver hasn't implemented _init_vendor_properties() Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG cinder.volume.driver [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86945) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG oslo_db.sqlalchemy.engines [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86945) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG dbcounter [-] [86945] Writer thread running {{(pid=86945) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG cinder.db.api [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Building query based on filter {{(pid=86945) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG cinder.image.image_utils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86945) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 19:00:25 devstack cinder-volume[86945]: INFO cinder.keymgr.migration [None req-bdd6f3c9-0306-4a47-983e-dea6835a5c72 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG cinder.volume.drivers.quobyte [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=86945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG cinder.volume.drivers.quobyte [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=86945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:25 devstack cinder-volume[86945]: DEBUG oslo_concurrency.processutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=86945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:25 devstack sudo[87023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:00:25 devstack sudo[87023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:26 devstack sudo[87023]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:26 devstack cinder-volume[86945]: DEBUG oslo_concurrency.processutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.227s {{(pid=86945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:26 devstack cinder-volume[86945]: DEBUG cinder.manager [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Notifying Schedulers of capabilities ... {{(pid=86945) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:00:26 devstack cinder-volume[86945]: INFO cinder.volume.manager [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Driver initialization completed successfully. Jul 21 19:00:26 devstack cinder-volume[86945]: INFO cinder.manager [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Initiating service 3 cleanup Jul 21 19:00:26 devstack cinder-volume[86945]: INFO cinder.manager [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Service 3 cleanup completed. Jul 21 19:00:26 devstack cinder-volume[86945]: DEBUG cinder.service [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Creating RPC server for service cinder-volume {{(pid=86945) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 19:00:26 devstack cinder-volume[86945]: DEBUG cinder.service [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86945) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 19:00:26 devstack cinder-volume[86945]: INFO cinder.volume.manager [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 21 19:00:26 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:26 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:26 devstack cinder-volume[86945]: DEBUG cinder.volume.drivers.quobyte [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=86945) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:26 devstack cinder-volume[86945]: DEBUG cinder.volume.drivers.quobyte [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=86945) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:26 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86945) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:26 devstack cinder-volume[86945]: DEBUG oslo_concurrency.processutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=86945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:26 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:00:26 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:26 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:26 devstack cinder-volume[86945]: DEBUG oslo_concurrency.processutils [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.268s {{(pid=86945) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:26 devstack cinder-volume[86945]: INFO cinder.volume.manager [None req-7d3527ef-4a49-42cd-81ee-6394e1f9b963 None None] Driver post RPC initialization completed successfully. Jul 21 19:00:30 devstack cinder-volume[86731]: INFO oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Caught SIGTERM, stopping children Jul 21 19:00:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Acquiring lock "singleton_lock" {{(pid=86731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 19:00:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Acquired lock "singleton_lock" {{(pid=86731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 19:00:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Releasing lock "singleton_lock" {{(pid=86731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 19:00:30 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Stop services. {{(pid=86731) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 21 19:00:30 devstack cinder-volume[86731]: DEBUG oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Killing children. {{(pid=86731) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 21 19:00:30 devstack cinder-volume[86731]: INFO oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Waiting on 1 children to exit Jul 21 19:00:30 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Acquiring lock "singleton_lock" {{(pid=86945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 19:00:30 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Acquired lock "singleton_lock" {{(pid=86945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 19:00:30 devstack cinder-volume[86945]: DEBUG oslo_concurrency.lockutils [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Releasing lock "singleton_lock" {{(pid=86945) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 19:00:30 devstack cinder-volume[86945]: WARNING amqp [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 19:00:30 devstack cinder-volume[86945]: WARNING amqp [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 19:00:30 devstack cinder-volume[86731]: INFO oslo_service.backend._eventlet.service [None req-e658f3b4-c46c-48ef-9608-3b13f3ed0dab None None] Child 86945 exited with status 0 Jul 21 19:00:30 devstack cinder-volume[87216]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 19:00:30 devstack cinder-volume[87216]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 19:00:30 devstack cinder-volume[87216]: we strongly recommend against using it for new projects. Jul 21 19:00:30 devstack cinder-volume[87216]: If you are already using Eventlet, we recommend migrating to a different Jul 21 19:00:30 devstack cinder-volume[87216]: framework. For more detail see Jul 21 19:00:30 devstack cinder-volume[87216]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 19:00:30 devstack cinder-volume[87216]: import eventlet # noqa Jul 21 19:00:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87216) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 19:00:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87216) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 19:00:33 devstack cinder-volume[87216]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87216) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 19:00:34 devstack cinder-volume[87216]: INFO dbcounter [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] Registered counter for database cinder Jul 21 19:00:34 devstack cinder-volume[87216]: DEBUG oslo_db.sqlalchemy.engines [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87216) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writer thread running {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 19:00:35 devstack cinder-volume[87216]: INFO cinder.rpc [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 19:00:35 devstack cinder-volume[87216]: INFO cinder.rpc [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_db.sqlalchemy.engines [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87216) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:00:35 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] Determined volume DB was empty at startup. Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG cinder.volume.manager [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87216) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 19:00:35 devstack cinder-volume[87216]: WARNING stevedore.named [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 19:00:35 devstack cinder-volume[87216]: WARNING castellan.key_manager [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 19:00:35 devstack cinder-volume[87216]: WARNING cinder.keymgr.conf_key_mgr [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 19:00:35 devstack cinder-volume[87216]: INFO cinder.volume.manager [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_db.sqlalchemy.engines [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87216) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:00:35 devstack cinder-volume[87216]: INFO oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] Starting 1 workers Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] Started child 87487 {{(pid=87216) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] Full set of CONF: {{(pid=87216) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] ******************************************************************************** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] Configuration options gathered from: {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] ================================================================================ {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] allow_availability_zone_fallback = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87487]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] allow_compression_on_image_upload = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] allowed_direct_url_schemes = [] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] api_rate_limit = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] auth_strategy = keystone {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_availability_zone = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_host = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_name = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_stats_polling_interval = 60 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backup_api_class = cinder.backup.api.API {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backup_name_template = backup-%s {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backup_use_same_host = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backup_use_temp_snapshot = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] chap_password = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] chap_username = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cinder_internal_tenant_project_id = a3659193c2d64f83816a216fd1ebf24c {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cinder_internal_tenant_user_id = 1ad02ee838e94070938160ad4fb1ac29 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cluster = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] compression_format = gzip {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] compute_api_class = cinder.compute.nova.API {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] config_dir = [] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] config_source = [] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] control_exchange = openstack {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] debug = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] default_availability_zone = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] default_group_type = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] default_volume_type = QuobyteHD {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] disk_geometry = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] driver_client_cert = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] driver_client_cert_key = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] driver_data_namespace = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] driver_ssl_cert_path = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] driver_ssl_cert_verify = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] driver_use_ssl = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] enable_new_services = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] enable_unsupported_driver = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] enabled_backends = ['QuobyteHD'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] enforce_multipath_for_image_xfer = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] filter_function = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance_api_insecure = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance_api_ssl_compression = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance_ca_certificates_file = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance_catalog_info = image:glance:publicURL {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance_certfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance_keyfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance_num_retries = 3 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance_request_timeout = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] goodness_function = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] graceful_shutdown_timeout = 5 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] group_api_class = cinder.group.api.API {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] host = devstack {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] image_compress_on_upload = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] image_conversion_address_space_limit = 1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] image_conversion_cpu_limit = 60 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] image_conversion_disable = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] image_upload_use_cinder_backend = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] image_upload_use_internal_tenant = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] image_volume_cache_enabled = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] image_volume_cache_max_count = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] image_volume_cache_max_size_gb = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] init_host_max_objects_retrieval = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] instance_format = [instance: %(uuid)s] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] iscsi_target_flags = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] iscsi_write_cache = on {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] iser_helper = tgtadm {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] iser_ip_address = 192.168.122.213 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] iser_port = 3260 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] log_color = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] log_config_append = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] log_dir = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] log_file = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] log_options = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] log_rotate_interval = 1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] log_rotate_interval_type = days {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] log_rotation_type = none {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] max_age = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] max_logfile_count = 30 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] max_logfile_size_mb = 200 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] max_over_subscription_ratio = 20.0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] message_reap_interval = 86400 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] message_ttl = 2592000 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] migration_create_volume_timeout_secs = 300 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] monkey_patch = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] monkey_patch_modules = [] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] my_ip = 192.168.122.213 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] no_snapshot_gb_quota = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] num_iser_scan_tries = 3 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] num_shell_tries = 3 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] num_volume_device_scan_tries = 3 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] nvmeof_conn_info_version = 1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] nvmet_ns_id = 10 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] nvmet_port_id = 1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Starting volume driver QuobyteDriver (1.2) Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] osapi_max_limit = 1000 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] osapi_volume_ext_list = [] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] osapi_volume_listen_port = 8776 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] osapi_volume_use_ssl = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] osapi_volume_workers = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] per_volume_size_limit = -1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87487) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] periodic_fuzzy_delay = 60 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] periodic_interval = 60 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] public_endpoint = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] publish_errors = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] quota_backup_gigabytes = 1000 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] quota_backups = 10 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] quota_gigabytes = 1000 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] quota_groups = 10 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] quota_snapshots = 10 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] quota_volumes = 10 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] rate_limit_burst = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] rate_limit_except_level = CRITICAL {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] rate_limit_interval = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] reinit_driver_count = 3 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] replication_device = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] report_discard_supported = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] report_interval = 120 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] reservation_clean_interval = 86400 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] reservation_expire = 86400 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] reserved_image_namespaces = [] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] reserved_percentage = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] rpc_response_timeout = 120 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:35 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] run_external_periodic_tasks = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] scst_target_driver = iscsi {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] scst_target_iqn_name = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] service_down_time = 720 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] shell_completion = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] snapshot_name_template = snapshot-%s {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] split_loggers = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] state_path = /opt/stack/data/cinder {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] storage_availability_zone = nova {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] storage_protocol = iSCSI {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] syslog_log_facility = LOG_USER {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] target_helper = lioadm {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] target_ip_address = 192.168.122.213 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] target_port = 3260 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] target_protocol = iscsi {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] target_secondary_ip_addresses = [] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] trace_flags = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] transport_url = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] until_refresh = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] use_chap_auth = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] use_default_quota_class = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] use_journal = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] use_json = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] use_multipath_for_image_xfer = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] use_stderr = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] use_syslog = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] verify_glance_signatures = enabled {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] volume_api_class = cinder.volume.api.API {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] volume_backend_name = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] volume_clear = zero {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] volume_clear_ionice = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] volume_clear_size = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] volume_copy_bps_limit = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] volume_dd_blocksize = 1M {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] volume_name_template = volume-%s {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] volume_service_inithost_offload = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] volume_usage_audit_period = month {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] zoning_mode = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_concurrency.disable_process_locking = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87487) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 21 19:00:36 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.quobyte [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 21 19:00:36 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.quobyte [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Running cmd (subprocess): mount.quobyte {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.auth_section = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.auth_type = password {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.auth_version = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.cache = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.certfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.include_service_catalog = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.insecure = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.interface = public {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.keyfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_password = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcache_username = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.region_name = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.service_type = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.backend = dogpile.cache.null {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.backend_argument = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.backend_expiration_time = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.config_prefix = cache.oslo {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.debug_cache_backend = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.enable_retry_client = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.enable_socket_keepalive = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.enabled = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.expiration_time = 600 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.hashclient_retry_attempts = 2 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.memcache_dead_retry = 300 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.memcache_pool_maxsize = 10 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.memcache_sasl_enabled = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.password = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.proxies = [] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.redis_db = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.redis_server = localhost:6379 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.retry_attempts = 2 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.retry_delay = 0.0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.socket_keepalive_count = 1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.socket_keepalive_idle = 1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.socket_keepalive_interval = 1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.socket_timeout = 1.0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.tls_allowed_ciphers = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.tls_cafile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.tls_certfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.tls_enabled = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.tls_keyfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cache.username = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] coordination.backend_url = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.asyncio_connection = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.asyncio_slave_connection = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.backend = sqlalchemy {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.connection = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.connection_debug = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.connection_parameters = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.connection_recycle_time = 3600 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.connection_trace = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack quobyte-client[87495]: Reading configuration file: /etc/quobyte/client.cfg Jul 21 19:00:36 devstack quobyte-client[87495]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.db_inc_retry_interval = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.db_max_retries = 20 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.db_max_retry_interval = 10 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] CMD "mount.quobyte" returned: 1 in 0.107s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.db_retry_interval = 1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.max_overflow = 50 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.max_pool_size = 5 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.max_retries = 10 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.mysql_wsrep_sync_wait = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.pool_timeout = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.retry_interval = 10 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.slave_connection = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.sqlite_synchronous = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.synchronous_reader = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] database.use_db_reconnect = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] profiler.connection_string = messaging:// {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] profiler.enabled = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] profiler.es_doc_type = notification {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] profiler.es_scroll_size = 10000 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] profiler.es_scroll_time = 2m {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] profiler.filter_error_trace = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] profiler.hmac_keys = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] profiler.sentinel_service_name = mymaster {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] profiler.socket_timeout = 0.1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] profiler.trace_requests = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] profiler.trace_sqlalchemy = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] profiler_jaeger.process_tags = {} {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] profiler_jaeger.service_name_prefix = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] profiler_otlp.service_name_prefix = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_policy.enforce_new_defaults = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_policy.policy_default_rule = default {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_policy.policy_file = policy.yaml {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] privsep_osbrick.group = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] privsep_osbrick.helper_command = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] privsep_osbrick.user = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cinder_sys_admin.group = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cinder_sys_admin.helper_command = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] cinder_sys_admin.user = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] service_user.auth_section = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] service_user.auth_type = password {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] service_user.cafile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] service_user.certfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] service_user.collect_timing = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] service_user.insecure = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] service_user.keyfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] service_user.send_service_user_token = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] service_user.split_loggers = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] service_user.timeout = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance.auth_section = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance.auth_type = password {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance.certfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance.collect_timing = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance.insecure = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance.keyfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance.region_name = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance.split_loggers = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] glance.timeout = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.backend_availability_zone = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.chap_password = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.chap_username = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack sudo[87497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.disk_geometry = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.driver_client_cert = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.driver_client_cert_key = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.driver_data_namespace = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.driver_use_ssl = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.extra_capabilities = {} {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.filter_function = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.goodness_function = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.iscsi_target_flags = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.iscsi_write_cache = on {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.iser_helper = tgtadm {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.iser_port = 3260 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.nas_host = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.nas_login = admin {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.nas_mount_options = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.nas_password = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.nas_private_key = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.nas_share_path = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.num_shell_tries = 3 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.quobyte_volume_url = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.replication_device = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.report_discard_supported = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.reserved_percentage = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.target_helper = tgtadm {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.target_port = 3260 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.target_protocol = iscsi {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.trace_flags = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.unique_fqdn_network = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.use_chap_auth = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.volume_backend_name = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.volume_clear = zero {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.volume_clear_ionice = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.volume_clear_size = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_reports.file_event_handler = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_reports.log_dir = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.backend_availability_zone = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.backend_host = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.chap_password = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.chap_username = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.chiscsi_conf = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.disk_geometry = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.driver_client_cert = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.driver_data_namespace = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.driver_use_ssl = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.extra_capabilities = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.filter_function = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.goodness_function = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.iser_helper = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.iser_ip_address = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.iser_port = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.iser_target_prefix = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.nas_host = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.nas_login = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.nas_mount_options = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.nas_password = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.nas_private_key = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.nas_share_path = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.nas_ssh_port = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.num_shell_tries = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.nvmet_port_id = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.replication_device = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.report_discard_supported = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.reserved_percentage = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.scst_target_driver = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.storage_protocol = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.target_helper = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.target_ip_address = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.target_port = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.target_prefix = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.target_protocol = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.trace_flags = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.use_chap_auth = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.volume_clear = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.volume_clear_size = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] QuobyteHD.volumes_dir = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.ssl = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_notifications.driver = [] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_notifications.retry = -1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] key_manager.fixed_key = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.barbican_api_version = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.barbican_endpoint = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.barbican_endpoint_type = public {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.barbican_region_name = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.cafile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.certfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.collect_timing = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.insecure = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.keyfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.number_of_retries = 60 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.retry_delay = 1 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.send_service_user_token = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.split_loggers = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.timeout = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.verify_ssl = True {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican.verify_ssl_path = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican_service_user.auth_section = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican_service_user.auth_type = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican_service_user.cafile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican_service_user.certfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican_service_user.collect_timing = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican_service_user.insecure = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican_service_user.keyfile = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican_service_user.split_loggers = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] barbican_service_user.timeout = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.approle_role_id = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.approle_secret_id = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.auth_method = approle {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.auth_path = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.kv_mountpoint = secret {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.kv_path = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.kv_version = 2 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.namespace = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.root_token_id = **** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.ssl_ca_crt_file = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.timeout = 60.0 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.token_file = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.token_role = None {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.use_ssl = False {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:00:36 devstack cinder-volume[87216]: DEBUG oslo_service.backend._eventlet.service [None req-fd20f179-2662-48e6-b7da-21c2a2b3f646 None None] ******************************************************************************** {{(pid=87216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 19:00:36 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.396s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:36 devstack cinder-volume[87487]: INFO cinder.volume.driver [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Driver hasn't implemented _init_vendor_properties() Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG cinder.volume.driver [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.754280090332, 'free_capacity_gb': 1775.754280090332, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87487) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG oslo_db.sqlalchemy.engines [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87487) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writer thread running {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG cinder.db.api [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Building query based on filter {{(pid=87487) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87487) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:36 devstack cinder-volume[87487]: INFO cinder.keymgr.migration [None req-b6a9dd24-7982-4e4a-b794-56cc6b3f954e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 19:00:36 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:00:36 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.317s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:36 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:36 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:00:37 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Driver initialization completed successfully. Jul 21 19:00:37 devstack cinder-volume[87487]: INFO cinder.manager [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Initiating service 3 cleanup Jul 21 19:00:37 devstack cinder-volume[87487]: INFO cinder.manager [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Service 3 cleanup completed. Jul 21 19:00:37 devstack cinder-volume[87487]: DEBUG cinder.service [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Creating RPC server for service cinder-volume {{(pid=87487) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 19:00:37 devstack cinder-volume[87487]: DEBUG cinder.service [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87487) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 19:00:37 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 21 19:00:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:37 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:00:37 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:37 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.384s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:37 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-06eefd90-ecf7-4bec-be38-b33c1035c924 None None] Driver post RPC initialization completed successfully. Jul 21 19:00:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:00:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 6 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:00:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:00:45 devstack cinder-volume[87216]: DEBUG dbcounter [-] [87216] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:00:46 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-39db3a28-2723-41ba-8007-8870a0ffc728 tempest-BackendsCapabilitiesAdminTestsJSON-155819572 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.754280090332, 'free_capacity_gb': 1775.754280090332, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87487) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 19:00:46 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-71e8a9a9-42ae-4b6a-b41e-334d2ea370f3 tempest-BackendsCapabilitiesAdminTestsJSON-155819572 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.754280090332, 'free_capacity_gb': 1775.754280090332, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87487) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 19:00:47 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:00:47 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=3 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:01:37 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3821e532-0a69-4b1a-a307-190c8da5f7e5 tempest-GroupSnapshotsTest-273162615 None] Group tempest-GroupSnapshotsTest-Group-241216947: creating Jul 21 19:01:37 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3821e532-0a69-4b1a-a307-190c8da5f7e5 tempest-GroupSnapshotsTest-273162615 None] Group tempest-GroupSnapshotsTest-Group-241216947: created successfully Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Flow 'volume_create_manager' (16d2c73a-f4d0-426d-b864-f9aeef3868d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e06d8a-077d-4ae1-b9f6-d3458c806d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:37 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3821e532-0a69-4b1a-a307-190c8da5f7e5 tempest-GroupSnapshotsTest-273162615 None] Create group completed successfully. Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e06d8a-077d-4ae1-b9f6-d3458c806d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1073987711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b03ee05-9021-471c-a28b-08f02b2739dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb47b11410924206bc618ec898cfdf7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:01:37Z,use_quota=True,user_id='a411b2826cc344b9930b05608c72a06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679c6d73-bca1-45fa-ab9d-9b7a712386ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679c6d73-bca1-45fa-ab9d-9b7a712386ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25915422-35f8-42e5-a2fd-397fac150678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25915422-35f8-42e5-a2fd-397fac150678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b03ee05-9021-471c-a28b-08f02b2739dd', 'volume_name': 'volume-7b03ee05-9021-471c-a28b-08f02b2739dd', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0af4d0b-3417-46c2-be3c-5da809e78825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0af4d0b-3417-46c2-be3c-5da809e78825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17baefa6-53e4-406f-af9e-b41deec8d55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:37 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Volume 7b03ee05-9021-471c-a28b-08f02b2739dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b03ee05-9021-471c-a28b-08f02b2739dd', 'volume_size': 1} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1073987711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b03ee05-9021-471c-a28b-08f02b2739dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb47b11410924206bc618ec898cfdf7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:01:37Z,use_quota=True,user_id='a411b2826cc344b9930b05608c72a06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Creating volume 7b03ee05-9021-471c-a28b-08f02b2739dd {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:01:37 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:01:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7b03ee05-9021-471c-a28b-08f02b2739dd 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:37 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7b03ee05-9021-471c-a28b-08f02b2739dd 1073741824 Jul 21 19:01:37 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:38 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7b03ee05-9021-471c-a28b-08f02b2739dd 1073741824" returned: 0 in 1.099s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7b03ee05-9021-471c-a28b-08f02b2739dd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:39 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7b03ee05-9021-471c-a28b-08f02b2739dd Jul 21 19:01:39 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:39 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7b03ee05-9021-471c-a28b-08f02b2739dd" returned: 0 in 0.425s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17baefa6-53e4-406f-af9e-b41deec8d55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b03ee05-9021-471c-a28b-08f02b2739dd', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1965a3b1-f506-400d-8dcd-ac94041a1bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:39 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Volume volume-7b03ee05-9021-471c-a28b-08f02b2739dd (7b03ee05-9021-471c-a28b-08f02b2739dd): created successfully Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1965a3b1-f506-400d-8dcd-ac94041a1bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Flow 'volume_create_manager' (16d2c73a-f4d0-426d-b864-f9aeef3868d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:01:39 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-1fb25e6d-0a8a-4be1-9d76-1fbe6872403e tempest-DeleteServersTestJSON-1834473909 None] Created volume successfully. Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Flow 'volume_create_manager' (2d14762e-1f2c-467f-bb08-5ff7331652b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a889a5a-10ed-43d6-b5c5-44f49f08cbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a889a5a-10ed-43d6-b5c5-44f49f08cbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1027500739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d6bd7ea-6c4a-4bdd-9c34-80571f983ef6,host='devstack@QuobyteHD#QuobyteHD',id=f855ac6f-8528-46b7-942f-7e1c02cac9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363575b2000546bf8e4a8d9d205312b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:01:40Z,use_quota=True,user_id='e7e573382d1642df9471febead5e1324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b2803c7-4ebf-4449-852d-3b1fa450b924),volume_type_id=4b2803c7-4ebf-4449-852d-3b1fa450b924)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22defea3-a376-464f-8885-6edaf5206ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22defea3-a376-464f-8885-6edaf5206ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f453e50-ad00-4877-92f2-4f292076efde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f453e50-ad00-4877-92f2-4f292076efde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f855ac6f-8528-46b7-942f-7e1c02cac9e4', 'volume_name': 'volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a95e611-9400-4a7f-8b88-f749e8504309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a95e611-9400-4a7f-8b88-f749e8504309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25332b4a-fe90-4016-9327-5c4e4256e7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:39 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Volume f855ac6f-8528-46b7-942f-7e1c02cac9e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4', 'volume_size': 1} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6d6bd7ea-6c4a-4bdd-9c34-80571f983ef6,created_at=2026-07-21T17:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1027500739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d6bd7ea-6c4a-4bdd-9c34-80571f983ef6,host='devstack@QuobyteHD#QuobyteHD',id=f855ac6f-8528-46b7-942f-7e1c02cac9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363575b2000546bf8e4a8d9d205312b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:01:40Z,use_quota=True,user_id='e7e573382d1642df9471febead5e1324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b2803c7-4ebf-4449-852d-3b1fa450b924),volume_type_id=4b2803c7-4ebf-4449-852d-3b1fa450b924)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Creating volume f855ac6f-8528-46b7-942f-7e1c02cac9e4 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:01:39 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:01:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:39 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 1073741824 Jul 21 19:01:39 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:01:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:40 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:01:40 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:40 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 1073741824" returned: 0 in 0.893s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:40 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 Jul 21 19:01:40 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:41 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.477s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:41 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:01:41 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:01:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 6 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:01:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:01:41 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4" returned: 0 in 0.435s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:01:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25332b4a-fe90-4016-9327-5c4e4256e7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180f2bbe-59dc-4264-99e4-50cbb6276c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:41 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Volume volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 (f855ac6f-8528-46b7-942f-7e1c02cac9e4): created successfully Jul 21 19:01:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180f2bbe-59dc-4264-99e4-50cbb6276c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Flow 'volume_create_manager' (2d14762e-1f2c-467f-bb08-5ff7331652b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:01:41 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f092981d-c68d-40ad-8d3f-745ac6544192 tempest-GroupSnapshotsTest-273162615 None] Created volume successfully. Jul 21 19:01:42 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] GroupSnapshot 41cd07d6-703d-4b2a-a96a-589c6a92495d: creating. Jul 21 19:01:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] Group snapshot 41cd07d6-703d-4b2a-a96a-589c6a92495d: creating. {{(pid=87487) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 19:01:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] Creating offline snapshot e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 of volume f855ac6f-8528-46b7-942f-7e1c02cac9e4 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:01:43 devstack cinder-volume[87487]: INFO oslo.privsep.daemon [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkf36hk9b/privsep.sock'] Jul 21 19:01:43 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkf36hk9b/privsep.sock Jul 21 19:01:43 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:44 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:01:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Flow 'volume_create_manager' (e0c790b3-4f61-406e-8ee8-199ad8d1c1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:01:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76babf3-96d3-4410-9ec7-53775fac9fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:44 devstack cinder-volume[87487]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 21 19:01:44 devstack cinder-volume[87487]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 19:01:44 devstack cinder-volume[87487]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 21 19:01:44 devstack cinder-volume[87487]: WARNING oslo.privsep.daemon [-] privsep log: Jul 21 19:01:44 devstack cinder-volume[87487]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 21 19:01:44 devstack cinder-volume[87487]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 21 19:01:44 devstack cinder-volume[87487]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 19:01:44 devstack cinder-volume[87487]: WARNING oslo.privsep.daemon [-] privsep log: Jul 21 19:01:44 devstack cinder-volume[87487]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 21 19:01:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76babf3-96d3-4410-9ec7-53775fac9fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-999385390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245984d7-c398-4084-82db-2da4f741ffb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ea5253e04d4638a7f07854bc740384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:01:45Z,use_quota=True,user_id='4ea3cadde959465d8060680a9daebbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76436f9-bcb5-40cd-9054-ee26e4ec63fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76436f9-bcb5-40cd-9054-ee26e4ec63fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85985df3-f275-4424-9117-18a756e1cfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85985df3-f275-4424-9117-18a756e1cfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '245984d7-c398-4084-82db-2da4f741ffb8', 'volume_name': 'volume-245984d7-c398-4084-82db-2da4f741ffb8', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ff4510-ad7b-4cf4-b5ea-4b9160315839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ff4510-ad7b-4cf4-b5ea-4b9160315839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a4b5c3-37be-4f5e-bfec-cd0720a67555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:44 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Volume 245984d7-c398-4084-82db-2da4f741ffb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-245984d7-c398-4084-82db-2da4f741ffb8', 'volume_size': 1} Jul 21 19:01:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:44 devstack cinder-volume[87487]: WARNING py.warnings [req-4b3f5429-d91b-4192-acd7-52fa5b9de8be req-9174fb69-e8a1-42da-99da-2b83d6520fe5 tempest-DeleteServersTestJSON-1834473909 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 21 19:01:44 devstack cinder-volume[87487]: .first() Jul 21 19:01:44 devstack cinder-volume[87487]: Jul 21 19:01:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-4b3f5429-d91b-4192-acd7-52fa5b9de8be req-9174fb69-e8a1-42da-99da-2b83d6520fe5 tempest-DeleteServersTestJSON-1834473909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:45 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:45 devstack cinder-volume[87487]: INFO oslo.privsep.daemon [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] Spawned new privsep daemon via rootwrap Jul 21 19:01:45 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] Accepted privsep connection to /tmp/tmpkf36hk9b/privsep.sock {{(pid=87487) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 21 19:01:45 devstack cinder-volume[87487]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 21 19:01:45 devstack cinder-volume[87487]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 21 19:01:45 devstack cinder-volume[87487]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 21 19:01:45 devstack cinder-volume[87487]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88594 Jul 21 19:01:45 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b448db-4ac2-44f8-b111-144055e3a111]: (2,) {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:45 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7881c112-0b81-4738-9db7-52c0448593ed]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:45 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 Jul 21 19:01:45 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:45 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4" returned: 0 in 0.531s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:45 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 1G Jul 21 19:01:45 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:46 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 1G" returned: 0 in 0.713s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:46 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 Jul 21 19:01:46 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:46 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331" returned: 0 in 0.513s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:46 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:01:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:46 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 Jul 21 19:01:46 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:47 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331" returned: 0 in 0.431s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:47 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.info Jul 21 19:01:47 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:47 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.info" returned: 0 in 0.287s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:47 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:01:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:47 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.info Jul 21 19:01:47 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:48 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.info" returned: 0 in 0.501s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.217s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.225s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-999385390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245984d7-c398-4084-82db-2da4f741ffb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ea5253e04d4638a7f07854bc740384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:01:45Z,use_quota=True,user_id='4ea3cadde959465d8060680a9daebbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:01:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Creating volume 245984d7-c398-4084-82db-2da4f741ffb8 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:01:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:01:48 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:01:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-245984d7-c398-4084-82db-2da4f741ffb8 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:48 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-245984d7-c398-4084-82db-2da4f741ffb8 1073741824 Jul 21 19:01:48 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:48 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-dd8f5dc3-70b9-4cd4-b898-20e692eb68cc tempest-GroupSnapshotsTest-273162615 None] group_snapshot 41cd07d6-703d-4b2a-a96a-589c6a92495d: created successfully Jul 21 19:01:48 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-245984d7-c398-4084-82db-2da4f741ffb8 1073741824" returned: 0 in 0.493s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-245984d7-c398-4084-82db-2da4f741ffb8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:48 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-245984d7-c398-4084-82db-2da4f741ffb8 Jul 21 19:01:48 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:48 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-245984d7-c398-4084-82db-2da4f741ffb8" returned: 0 in 0.280s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:01:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-4b3f5429-d91b-4192-acd7-52fa5b9de8be req-9174fb69-e8a1-42da-99da-2b83d6520fe5 tempest-DeleteServersTestJSON-1834473909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.021s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-4b3f5429-d91b-4192-acd7-52fa5b9de8be req-9174fb69-e8a1-42da-99da-2b83d6520fe5 tempest-DeleteServersTestJSON-1834473909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a4b5c3-37be-4f5e-bfec-cd0720a67555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-245984d7-c398-4084-82db-2da4f741ffb8', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deff186d-0632-4b90-bfb6-1f237e73361d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:49 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Volume volume-245984d7-c398-4084-82db-2da4f741ffb8 (245984d7-c398-4084-82db-2da4f741ffb8): created successfully Jul 21 19:01:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deff186d-0632-4b90-bfb6-1f237e73361d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Flow 'volume_create_manager' (e0c790b3-4f61-406e-8ee8-199ad8d1c1dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:01:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-4b3f5429-d91b-4192-acd7-52fa5b9de8be req-9174fb69-e8a1-42da-99da-2b83d6520fe5 tempest-DeleteServersTestJSON-1834473909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-7b03ee05-9021-471c-a28b-08f02b2739dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ecce2ffd-1554-4697-9c4a-7447aa9052ee', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:01:49 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4d098f2a-53b1-4dd5-8ea7-f90d83c8ae18 tempest-VolumesAdminNegativeTest-1650549973 None] Created volume successfully. Jul 21 19:01:49 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-4b3f5429-d91b-4192-acd7-52fa5b9de8be req-9174fb69-e8a1-42da-99da-2b83d6520fe5 tempest-DeleteServersTestJSON-1834473909 None] attachment_update completed successfully. Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331-3110dcd3-5e75-435c-adda-f8055eeaf9f1" by "_create_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331-3110dcd3-5e75-435c-adda-f8055eeaf9f1" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Creating volume 3110dcd3-5e75-435c-adda-f8055eeaf9f1 from snapshot e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 {{(pid=87487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-3110dcd3-5e75-435c-adda-f8055eeaf9f1" by "_copy_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-3110dcd3-5e75-435c-adda-f8055eeaf9f1" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] snapshot: e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331, volume: 3110dcd3-5e75-435c-adda-f8055eeaf9f1, {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa4b0f9-d146-409d-99ff-35844e3f49d3]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Acquiring lock "cinder-245984d7-c398-4084-82db-2da4f741ffb8-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:51 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 Jul 21 19:01:51 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Lock "cinder-245984d7-c398-4084-82db-2da4f741ffb8-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Acquiring lock "cinder-quobyte-245984d7-c398-4084-82db-2da4f741ffb8" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Lock "cinder-quobyte-245984d7-c398-4084-82db-2da4f741ffb8" acquired by "delete_volume" :: waited 0.080s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:51 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[965bc3fc-3f50-4b3f-a741-a98b34a49718]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-245984d7-c398-4084-82db-2da4f741ffb8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:51 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-245984d7-c398-4084-82db-2da4f741ffb8 Jul 21 19:01:51 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:51 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331" returned: 0 in 0.851s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:01:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:01:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Creating direct copy from snapshot {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:01:51 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29f95b4-65df-4584-adc9-d0f6f67406e0]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:52 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 Jul 21 19:01:52 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:52 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-245984d7-c398-4084-82db-2da4f741ffb8" returned: 0 in 0.680s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-245984d7-c398-4084-82db-2da4f741ffb8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:52 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-245984d7-c398-4084-82db-2da4f741ffb8 Jul 21 19:01:52 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:52 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4" returned: 0 in 0.489s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:52 devstack cinder-volume[87487]: DEBUG cinder.utils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Path /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1 not found in is_blk_device check {{(pid=87487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:01:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:52 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1 Jul 21 19:01:52 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:52 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-245984d7-c398-4084-82db-2da4f741ffb8" returned: 0 in 0.280s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Lock "cinder-quobyte-245984d7-c398-4084-82db-2da4f741ffb8" released by "delete_volume" :: held 1.077s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:52 devstack cinder-volume[87487]: WARNING cinder.quota [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:01:52 devstack cinder-volume[87487]: WARNING cinder.quota [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:01:52 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Created reservations ['dbda7df4-5ed8-48a3-be5d-50da0f1e0d50', '91954a28-f5ec-46d9-9775-77c5538eb716', '9b7adb1d-6851-4ab3-8fd7-2e1d5740f385', 'c3a63cb1-87f7-405d-b8e3-48ee17afdbd5'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:01:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:52 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:01:52 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:53 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.654s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:53 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:01:53 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Deleted volume successfully. Jul 21 19:01:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c213417f-c8ad-47c4-96d2-30056cdf6778 tempest-VolumesAdminNegativeTest-1650549973 None] Lock "cinder-245984d7-c398-4084-82db-2da4f741ffb8-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:56 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-bcbb7f95-b743-4ddc-82fe-4c8e026a244f req-6588e90f-927a-4ad3-8675-d5dcfe883bce tempest-DeleteServersTestJSON-1834473909 None] Terminate volume connection completed successfully. Jul 21 19:01:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-bcbb7f95-b743-4ddc-82fe-4c8e026a244f req-6588e90f-927a-4ad3-8675-d5dcfe883bce tempest-DeleteServersTestJSON-1834473909 None] Deleting attachment ecce2ffd-1554-4697-9c4a-7447aa9052ee. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:01:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Acquiring lock "cinder-7b03ee05-9021-471c-a28b-08f02b2739dd-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Lock "cinder-7b03ee05-9021-471c-a28b-08f02b2739dd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Acquiring lock "cinder-quobyte-7b03ee05-9021-471c-a28b-08f02b2739dd" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:59 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Lock "cinder-quobyte-7b03ee05-9021-471c-a28b-08f02b2739dd" acquired by "delete_volume" :: waited 0.078s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:59 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[090c9cdd-c62a-4fa6-90b0-925817d02bbd]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7b03ee05-9021-471c-a28b-08f02b2739dd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:59 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7b03ee05-9021-471c-a28b-08f02b2739dd Jul 21 19:01:59 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:59 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7b03ee05-9021-471c-a28b-08f02b2739dd" returned: 0 in 0.741s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7b03ee05-9021-471c-a28b-08f02b2739dd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:59 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7b03ee05-9021-471c-a28b-08f02b2739dd Jul 21 19:01:59 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:00 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1" returned: 0 in 7.733s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[af874ff1-3f96-449b-a29e-858cb3eccf64]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:00 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 Jul 21 19:02:00 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:00 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7b03ee05-9021-471c-a28b-08f02b2739dd" returned: 0 in 0.399s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Lock "cinder-quobyte-7b03ee05-9021-471c-a28b-08f02b2739dd" released by "delete_volume" :: held 1.247s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Created reservations ['13b68cc6-8dcd-4910-a015-1ca5294290c2', '9752ce5b-7483-4f7f-98d0-0e1c2d7e6b3a', '6c18da84-eb09-4aac-9201-032bae18ac47', '1e95c670-7c17-4b1d-80d6-6c678501d66e'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:00 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:02:00 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:00 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4" returned: 0 in 0.689s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4, size 1024.00 MB, duration 7.73 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:02:00 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Converted 1024.00 MB image at 132.39 MB/s Jul 21 19:02:00 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:00 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.330s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:00 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1 Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:02:00 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:00 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Deleted volume successfully. Jul 21 19:02:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0776d526-da9b-43f4-a66e-2430271c49c1 tempest-DeleteServersTestJSON-1834473909 None] Lock "cinder-7b03ee05-9021-471c-a28b-08f02b2739dd-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:01 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1" returned: 0 in 0.354s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-3110dcd3-5e75-435c-adda-f8055eeaf9f1" released by "_copy_volume_from_snapshot" :: held 10.288s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331-3110dcd3-5e75-435c-adda-f8055eeaf9f1" released by "_create_volume_from_snapshot" :: held 10.346s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.375s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:01 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ee34d0a9-a14a-4ab9-a564-baf171924717 tempest-GroupSnapshotsTest-273162615 None] Create group from source-snapshot-41cd07d6-703d-4b2a-a96a-589c6a92495d completed successfully. Jul 21 19:02:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-3110dcd3-5e75-435c-adda-f8055eeaf9f1" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-3110dcd3-5e75-435c-adda-f8055eeaf9f1" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:02 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[384c80dd-cb52-4110-9d9b-d04bc3829577]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:02 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1 Jul 21 19:02:02 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:02 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1" returned: 0 in 0.462s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:02 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1 Jul 21 19:02:02 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:03 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3110dcd3-5e75-435c-adda-f8055eeaf9f1" returned: 0 in 0.369s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-3110dcd3-5e75-435c-adda-f8055eeaf9f1" released by "delete_volume" :: held 0.891s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Created reservations ['707d6d13-5701-439b-aa4c-a3681faf09bc'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:03 devstack cinder-volume[87487]: WARNING cinder.quota [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1753708094 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1753708094, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:02:03 devstack cinder-volume[87487]: WARNING cinder.quota [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1753708094 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1753708094, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Created reservations ['9fb3e759-f0af-47f2-a4a1-aed31f0833c9', 'faa8830b-f534-4954-ab23-8509c60e5f9c', 'aa79854d-8c61-4133-b892-18c4bf46cbc9', 'cf8e3588-cfad-45e1-a65e-0306b8d8b747'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:03 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:02:03 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:03 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] group_snapshot 41cd07d6-703d-4b2a-a96a-589c6a92495d: deleting Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] group_snapshot 41cd07d6-703d-4b2a-a96a-589c6a92495d: deleting {{(pid=87487) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-f855ac6f-8528-46b7-942f-7e1c02cac9e4" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-f855ac6f-8528-46b7-942f-7e1c02cac9e4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:03 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.316s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] Deleting offline snapshot e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 of volume f855ac6f-8528-46b7-942f-7e1c02cac9e4 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] snapshot_file for this snap is: volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:02:03 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f5831183-12c3-41a6-a48b-f8f0ad6682f5 tempest-GroupSnapshotsTest-273162615 None] Delete group completed successfully. Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f0f016-590b-44db-b7a0-7aeeb5771d6f]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:04 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 Jul 21 19:02:04 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:04 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331" returned: 0 in 0.499s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:02:04 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[24faea52-33de-4eac-9c88-00c0f1c9686e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:04 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 Jul 21 19:02:04 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:04 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4" returned: 0 in 0.405s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:04 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 Jul 21 19:02:04 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:05 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331" returned: 0 in 0.434s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:05 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331 Jul 21 19:02:05 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:05 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4.e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331" returned: 0 in 0.345s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-e8a9e62b-1be0-4e2c-8f50-d4b5fc62d331" released by "_delete_snapshot" :: held 1.839s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-f855ac6f-8528-46b7-942f-7e1c02cac9e4" released by "delete_snapshot" :: held 1.878s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:05 devstack cinder-volume[87487]: WARNING cinder.quota [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1753708094 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1753708094, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:02:05 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] Created reservations ['4aa59eec-d780-4a18-8309-eb4695e515dc', '2c4fab46-6057-4d2e-b0bf-77e6027e95eb', '1ce8f86f-f3f4-4a63-9e55-ce506c404f25', 'f6b73ea1-4054-4c24-b526-1788a037105f'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9a8f884a-93a4-495a-8fc2-766478d2dc3f tempest-GroupSnapshotsTest-273162615 None] group_snapshot 41cd07d6-703d-4b2a-a96a-589c6a92495d: deleted successfully Jul 21 19:02:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-f855ac6f-8528-46b7-942f-7e1c02cac9e4" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-f855ac6f-8528-46b7-942f-7e1c02cac9e4" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[371d4913-645f-4d95-8b4a-cbc2302ad8b4]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:06 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 Jul 21 19:02:06 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:07 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4" returned: 0 in 0.599s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:07 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4 Jul 21 19:02:07 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:07 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f855ac6f-8528-46b7-942f-7e1c02cac9e4" returned: 0 in 0.270s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-f855ac6f-8528-46b7-942f-7e1c02cac9e4" released by "delete_volume" :: held 0.960s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:07 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Created reservations ['daeaa25d-0e1a-4443-899a-9ab2219b5c71'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:07 devstack cinder-volume[87487]: WARNING cinder.db.api [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1753708094'] Jul 21 19:02:07 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Created reservations ['0526e23f-c3c1-4854-a5a8-948ec95942b5', '28023173-bae4-4957-a770-4d5040875bda', 'f48f84f7-8684-415b-aafa-0576cb7b24e0', 'd9dfc31f-3083-4292-84f3-87e4e225b3d8'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:07 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:07 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:07 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:02:07 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:08 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.358s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:08 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:02:08 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-621bbc88-e17f-4042-9aab-ccbf6fd4c954 tempest-GroupSnapshotsTest-273162615 None] Delete group completed successfully. Jul 21 19:02:09 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-0c6f15ea-d7ae-42cc-b51e-30ce2f055a45 tempest-GroupSnapshotsTest-273162615 None] Group tempest-GroupSnapshotsTest-Group-931031632: creating Jul 21 19:02:09 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-0c6f15ea-d7ae-42cc-b51e-30ce2f055a45 tempest-GroupSnapshotsTest-273162615 None] Group tempest-GroupSnapshotsTest-Group-931031632: created successfully Jul 21 19:02:09 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-0c6f15ea-d7ae-42cc-b51e-30ce2f055a45 tempest-GroupSnapshotsTest-273162615 None] Create group completed successfully. Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Flow 'volume_create_manager' (b4a7e6e6-c616-424c-a8ab-102852a0cf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22425d6-12b9-420e-befb-1a2199f1b9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22425d6-12b9-420e-befb-1a2199f1b9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1090749723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb7b74f6-5ef4-4201-89f6-a11db09eae9c,host='devstack@QuobyteHD#QuobyteHD',id=14065ae7-7d28-4e3f-88cf-7e615bb7a4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363575b2000546bf8e4a8d9d205312b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:11Z,use_quota=True,user_id='e7e573382d1642df9471febead5e1324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56a1838f-7d71-4993-b46f-5ebc00281d36),volume_type_id=56a1838f-7d71-4993-b46f-5ebc00281d36)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39466e8c-fd1f-4fc2-abaa-7fa61a4c2c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39466e8c-fd1f-4fc2-abaa-7fa61a4c2c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0b936f-7c8e-416b-bf8b-0a523472cc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0b936f-7c8e-416b-bf8b-0a523472cc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14065ae7-7d28-4e3f-88cf-7e615bb7a4af', 'volume_name': 'volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c1ec01-1374-4e0f-bd06-f113e2bd48ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c1ec01-1374-4e0f-bd06-f113e2bd48ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f5921b-36f0-488d-8c42-61d5dbc01bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:11 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Volume 14065ae7-7d28-4e3f-88cf-7e615bb7a4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af', 'volume_size': 1} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fb7b74f6-5ef4-4201-89f6-a11db09eae9c,created_at=2026-07-21T17:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1090749723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb7b74f6-5ef4-4201-89f6-a11db09eae9c,host='devstack@QuobyteHD#QuobyteHD',id=14065ae7-7d28-4e3f-88cf-7e615bb7a4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363575b2000546bf8e4a8d9d205312b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:11Z,use_quota=True,user_id='e7e573382d1642df9471febead5e1324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56a1838f-7d71-4993-b46f-5ebc00281d36),volume_type_id=56a1838f-7d71-4993-b46f-5ebc00281d36)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Creating volume 14065ae7-7d28-4e3f-88cf-7e615bb7a4af {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:02:11 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:02:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:11 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af 1073741824 Jul 21 19:02:11 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:12 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af 1073741824" returned: 0 in 0.594s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:12 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af Jul 21 19:02:12 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:12 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af" returned: 0 in 0.262s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:02:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f5921b-36f0-488d-8c42-61d5dbc01bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d40951-4ba8-4be0-8a13-1b8b7e614fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:12 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Volume volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af (14065ae7-7d28-4e3f-88cf-7e615bb7a4af): created successfully Jul 21 19:02:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d40951-4ba8-4be0-8a13-1b8b7e614fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Flow 'volume_create_manager' (b4a7e6e6-c616-424c-a8ab-102852a0cf0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:12 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-7657869c-1e3e-4afe-a7f7-47fb243dcd6d tempest-GroupSnapshotsTest-273162615 None] Created volume successfully. Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Flow 'volume_create_manager' (1c662cda-ad40-4005-a3f0-4b3dff95d766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525cecef-2def-4e31-8166-8d1578edd646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525cecef-2def-4e31-8166-8d1578edd646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-863488709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb7b74f6-5ef4-4201-89f6-a11db09eae9c,host='devstack@QuobyteHD#QuobyteHD',id=8323d2e9-8583-49b4-be11-5232b0bcb4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363575b2000546bf8e4a8d9d205312b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:13Z,use_quota=True,user_id='e7e573382d1642df9471febead5e1324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56a1838f-7d71-4993-b46f-5ebc00281d36),volume_type_id=56a1838f-7d71-4993-b46f-5ebc00281d36)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a47a78-4f7e-4cf6-9cbe-1daa2f12506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a47a78-4f7e-4cf6-9cbe-1daa2f12506e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41eb7ced-3332-44bd-96f0-2267a4fc2761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41eb7ced-3332-44bd-96f0-2267a4fc2761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8323d2e9-8583-49b4-be11-5232b0bcb4ca', 'volume_name': 'volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85e6aa3-13fe-4142-afdc-ea79ecdbdf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85e6aa3-13fe-4142-afdc-ea79ecdbdf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1e5240-cdaf-4163-bdbe-46c87127baed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:13 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Volume 8323d2e9-8583-49b4-be11-5232b0bcb4ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca', 'volume_size': 1} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fb7b74f6-5ef4-4201-89f6-a11db09eae9c,created_at=2026-07-21T17:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-863488709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb7b74f6-5ef4-4201-89f6-a11db09eae9c,host='devstack@QuobyteHD#QuobyteHD',id=8323d2e9-8583-49b4-be11-5232b0bcb4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363575b2000546bf8e4a8d9d205312b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:13Z,use_quota=True,user_id='e7e573382d1642df9471febead5e1324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56a1838f-7d71-4993-b46f-5ebc00281d36),volume_type_id=56a1838f-7d71-4993-b46f-5ebc00281d36)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Creating volume 8323d2e9-8583-49b4-be11-5232b0bcb4ca {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:02:13 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:13 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca 1073741824 Jul 21 19:02:13 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:13 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca 1073741824" returned: 0 in 0.519s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:13 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca Jul 21 19:02:13 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:14 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca" returned: 0 in 0.263s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:02:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1e5240-cdaf-4163-bdbe-46c87127baed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd607fcb-9139-4a21-a559-cb511b7e1483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:14 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Volume volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca (8323d2e9-8583-49b4-be11-5232b0bcb4ca): created successfully Jul 21 19:02:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd607fcb-9139-4a21-a559-cb511b7e1483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Flow 'volume_create_manager' (1c662cda-ad40-4005-a3f0-4b3dff95d766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:14 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-50e713ec-f3c4-4eb2-9bbc-383bb84fb954 tempest-GroupSnapshotsTest-273162615 None] Created volume successfully. Jul 21 19:02:14 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b1b2b287-248b-444e-a8bc-1a436acc6762 tempest-GroupSnapshotsTest-273162615 None] Update group completed successfully. Jul 21 19:02:15 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-512b1dab-a047-4b3e-afb9-b2c26a48bf51 tempest-GroupSnapshotsTest-273162615 None] Update group completed successfully. Jul 21 19:02:17 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-712b7af1-a786-416e-8116-1a3deb75e21c tempest-GroupSnapshotsTest-273162615 None] Update group completed successfully. Jul 21 19:02:18 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d4ce25f4-272c-4615-bb6b-7d4ad8fb6739 tempest-GroupSnapshotsTest-273162615 None] Update group completed successfully. Jul 21 19:02:20 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] GroupSnapshot 06a7e2cf-ae7c-404c-beb7-8f865d0cb10f: creating. Jul 21 19:02:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Group snapshot 06a7e2cf-ae7c-404c-beb7-8f865d0cb10f: creating. {{(pid=87487) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 19:02:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Creating offline snapshot 92e126b7-c24b-4802-82b0-a068a1d950f3 of volume 8323d2e9-8583-49b4-be11-5232b0bcb4ca {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:02:20 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3a9c36-f9f8-4e37-aa7d-d005dd6a4333]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:20 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca Jul 21 19:02:20 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:20 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca" returned: 0 in 0.475s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:20 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 1G Jul 21 19:02:20 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:21 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 1G" returned: 0 in 0.591s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:21 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 Jul 21 19:02:21 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:21 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3" returned: 0 in 0.343s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:21 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:02:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:21 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 Jul 21 19:02:21 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:21 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3" returned: 0 in 0.280s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:21 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.info Jul 21 19:02:21 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:22 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.info" returned: 0 in 0.305s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:22 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:02:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:22 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.info Jul 21 19:02:22 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:22 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.info" returned: 0 in 0.266s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Creating offline snapshot c7e4a4a2-703d-4173-aba0-2a940328b412 of volume 14065ae7-7d28-4e3f-88cf-7e615bb7a4af {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:02:22 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd11cef-60f9-4cfd-bc85-2e0789076f8b]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:22 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af Jul 21 19:02:22 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:22 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af" returned: 0 in 0.395s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:22 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 1G Jul 21 19:02:22 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:23 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 1G" returned: 0 in 0.608s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:23 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 Jul 21 19:02:23 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:23 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412" returned: 0 in 0.423s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:23 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:02:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:23 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 Jul 21 19:02:23 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:24 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412" returned: 0 in 0.415s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:24 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.info Jul 21 19:02:24 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:24 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.info" returned: 0 in 0.326s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:24 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:02:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:24 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.info Jul 21 19:02:24 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:25 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.info" returned: 0 in 0.391s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4f657b53-5f45-4adb-8dbe-1a44227c292a tempest-GroupSnapshotsTest-273162615 None] group_snapshot 06a7e2cf-ae7c-404c-beb7-8f865d0cb10f: created successfully Jul 21 19:02:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] group_snapshot 06a7e2cf-ae7c-404c-beb7-8f865d0cb10f: deleting Jul 21 19:02:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] group_snapshot 06a7e2cf-ae7c-404c-beb7-8f865d0cb10f: deleting {{(pid=87487) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 19:02:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-8323d2e9-8583-49b4-be11-5232b0bcb4ca" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-8323d2e9-8583-49b4-be11-5232b0bcb4ca" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-92e126b7-c24b-4802-82b0-a068a1d950f3" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-92e126b7-c24b-4802-82b0-a068a1d950f3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Deleting offline snapshot 92e126b7-c24b-4802-82b0-a068a1d950f3 of volume 8323d2e9-8583-49b4-be11-5232b0bcb4ca {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:02:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] snapshot_file for this snap is: volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:02:25 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[910f8a09-9117-4ecc-b7c2-f166d34b709d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:26 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 Jul 21 19:02:26 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:26 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3" returned: 0 in 0.550s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:02:26 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f0442b-d53e-4697-8441-4d1f53ff7018]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:26 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca Jul 21 19:02:26 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:26 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca" returned: 0 in 0.525s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:26 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 Jul 21 19:02:26 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:27 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3" returned: 0 in 0.530s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:27 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3 Jul 21 19:02:27 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:27 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca.92e126b7-c24b-4802-82b0-a068a1d950f3" returned: 0 in 0.351s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-92e126b7-c24b-4802-82b0-a068a1d950f3" released by "_delete_snapshot" :: held 2.127s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-8323d2e9-8583-49b4-be11-5232b0bcb4ca" released by "delete_snapshot" :: held 2.168s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:27 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=85,cinder:UPDATE=67,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:02:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-14065ae7-7d28-4e3f-88cf-7e615bb7a4af" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-14065ae7-7d28-4e3f-88cf-7e615bb7a4af" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-c7e4a4a2-703d-4173-aba0-2a940328b412" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-c7e4a4a2-703d-4173-aba0-2a940328b412" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Deleting offline snapshot c7e4a4a2-703d-4173-aba0-2a940328b412 of volume 14065ae7-7d28-4e3f-88cf-7e615bb7a4af {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:02:28 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] snapshot_file for this snap is: volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:02:28 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc14d0f-2a73-46f6-be69-db993dca832a]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:28 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 Jul 21 19:02:28 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:28 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412" returned: 0 in 0.528s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:28 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:02:28 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[99af9faf-4f37-408e-aa8a-2216bb26eee3]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:28 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af Jul 21 19:02:28 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:29 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af" returned: 0 in 0.535s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:29 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 Jul 21 19:02:29 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:29 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412" returned: 0 in 0.440s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:29 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412 Jul 21 19:02:29 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:29 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af.c7e4a4a2-703d-4173-aba0-2a940328b412" returned: 0 in 0.322s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-c7e4a4a2-703d-4173-aba0-2a940328b412" released by "_delete_snapshot" :: held 1.998s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-14065ae7-7d28-4e3f-88cf-7e615bb7a4af" released by "delete_snapshot" :: held 2.040s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:30 devstack cinder-volume[87487]: WARNING cinder.quota [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1064264401 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1064264401, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:02:30 devstack cinder-volume[87487]: WARNING cinder.quota [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1064264401 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1064264401, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:02:30 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Created reservations ['ccac3d2f-3bcb-4dcf-8c85-a8bec5905851', 'df6a20a6-d995-482c-bfdc-c363acbbcccc', 'a53849c1-5d7e-49c0-a684-222ed92fd265', 'ac535bc3-881d-427e-9547-4dd26c6a93e7'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:30 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] Created reservations ['5632eb70-6f9e-4100-9586-fab0e6ec5570', 'b373cb34-6423-4d70-8483-22ade76bf211', '48a58192-1958-4499-93a4-ac2302461f5e', '1b3fef17-b64b-4e3f-b539-a6d9d06191c6'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:30 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-20563e49-dd31-4e04-a427-8cb8a56213cd tempest-GroupSnapshotsTest-273162615 None] group_snapshot 06a7e2cf-ae7c-404c-beb7-8f865d0cb10f: deleted successfully Jul 21 19:02:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-14065ae7-7d28-4e3f-88cf-7e615bb7a4af" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-14065ae7-7d28-4e3f-88cf-7e615bb7a4af" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:31 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b920fc1c-0de6-4b8a-b04d-51462933da86]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:31 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af Jul 21 19:02:31 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:31 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af" returned: 0 in 0.512s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:31 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af Jul 21 19:02:31 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:31 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-14065ae7-7d28-4e3f-88cf-7e615bb7a4af" returned: 0 in 0.395s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-14065ae7-7d28-4e3f-88cf-7e615bb7a4af" released by "delete_volume" :: held 1.031s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-8323d2e9-8583-49b4-be11-5232b0bcb4ca" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-8323d2e9-8583-49b4-be11-5232b0bcb4ca" acquired by "delete_volume" :: waited 0.025s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:32 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fcd1f8-b255-4c9e-94c7-383d2b45dfc8]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:32 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca Jul 21 19:02:32 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:32 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca" returned: 0 in 0.485s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:32 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca Jul 21 19:02:32 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:32 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8323d2e9-8583-49b4-be11-5232b0bcb4ca" returned: 0 in 0.428s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-8323d2e9-8583-49b4-be11-5232b0bcb4ca" released by "delete_volume" :: held 1.017s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:33 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Created reservations ['4a1abe62-48b1-4f6d-8c93-87d8c69b26a0'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:33 devstack cinder-volume[87487]: WARNING cinder.quota [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1064264401 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1064264401, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:02:33 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Created reservations ['f45fe100-7985-4cfa-8383-c876790aeab1', '04d4f0b1-2467-44fc-a555-0063af3d7c2f', '896b17c0-8dfa-44d8-98f5-165ec8667de9', 'e0e1658d-3b1d-4cf8-8d19-51dad1ca6789'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:33 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Created reservations ['462f1243-c670-401d-9809-a19d4bc55e3a', 'b972718d-27b4-4f18-beff-4e75a42046bf', '1a443a34-a445-4f52-9bc0-35b167f82a9a', 'e1407840-0b23-4012-b7a5-a8ef2d5a5f90'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:33 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:02:33 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:34 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.470s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:34 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:02:34 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a749ae46-46c9-4abe-a22c-4c5c2ade2e5b tempest-GroupSnapshotsTest-273162615 None] Delete group completed successfully. Jul 21 19:02:34 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-feb0f56c-73be-417e-87de-578dc264574c tempest-GroupSnapshotsTest-273162615 None] Group tempest-GroupSnapshotsTest-Group-883742341: creating Jul 21 19:02:34 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-feb0f56c-73be-417e-87de-578dc264574c tempest-GroupSnapshotsTest-273162615 None] Group tempest-GroupSnapshotsTest-Group-883742341: created successfully Jul 21 19:02:34 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-feb0f56c-73be-417e-87de-578dc264574c tempest-GroupSnapshotsTest-273162615 None] Create group completed successfully. Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Flow 'volume_create_manager' (e1a12097-ff9b-4076-baa1-a7418c8347ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f3f7bb-5a88-48f7-b4dc-f7f2fb3a57f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f3f7bb-5a88-48f7-b4dc-f7f2fb3a57f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-357071494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0de95291-1319-4a3d-8044-f8b224966363,host='devstack@QuobyteHD#QuobyteHD',id=4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363575b2000546bf8e4a8d9d205312b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:36Z,use_quota=True,user_id='e7e573382d1642df9471febead5e1324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f5ac710-1be6-4498-a8f5-03bafc5ab2fa),volume_type_id=7f5ac710-1be6-4498-a8f5-03bafc5ab2fa)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771785a9-6a82-4153-b289-20dfadf272f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771785a9-6a82-4153-b289-20dfadf272f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777491d2-3b79-4118-a4c8-c0a0115e9ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777491d2-3b79-4118-a4c8-c0a0115e9ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53', 'volume_name': 'volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2573b0-9213-4088-ac23-64542d306daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2573b0-9213-4088-ac23-64542d306daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b037d725-6d6b-4d54-b1ee-cff1b7dea338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:36 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Volume 4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53', 'volume_size': 1} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0de95291-1319-4a3d-8044-f8b224966363,created_at=2026-07-21T17:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-357071494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0de95291-1319-4a3d-8044-f8b224966363,host='devstack@QuobyteHD#QuobyteHD',id=4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363575b2000546bf8e4a8d9d205312b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:36Z,use_quota=True,user_id='e7e573382d1642df9471febead5e1324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f5ac710-1be6-4498-a8f5-03bafc5ab2fa),volume_type_id=7f5ac710-1be6-4498-a8f5-03bafc5ab2fa)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Creating volume 4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:02:36 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:02:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:36 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 1073741824 Jul 21 19:02:36 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:37 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 1073741824" returned: 0 in 0.583s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:37 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 Jul 21 19:02:37 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:37 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53" returned: 0 in 0.250s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:02:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b037d725-6d6b-4d54-b1ee-cff1b7dea338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2f3134-66c1-423d-b950-6400c4fa5293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:37 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=104,cinder:UPDATE=120,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:02:37 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Volume volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 (4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53): created successfully Jul 21 19:02:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2f3134-66c1-423d-b950-6400c4fa5293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Flow 'volume_create_manager' (e1a12097-ff9b-4076-baa1-a7418c8347ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:37 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-0cf1d0db-5a63-443a-b0ef-eb97db172ac6 tempest-GroupSnapshotsTest-273162615 None] Created volume successfully. Jul 21 19:02:39 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] GroupSnapshot ec178082-b78d-4068-881f-a2308d3813cf: creating. Jul 21 19:02:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] Group snapshot ec178082-b78d-4068-881f-a2308d3813cf: creating. {{(pid=87487) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 19:02:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] Creating offline snapshot a48ade7d-ba33-49ef-85d5-1c309c2d07cb of volume 4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:02:39 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa69c35b-9fdc-4c53-afa0-689eca004c38]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:39 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 Jul 21 19:02:39 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:39 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53" returned: 0 in 0.478s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:39 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb 1G Jul 21 19:02:39 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:40 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb 1G" returned: 0 in 0.636s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:40 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb Jul 21 19:02:40 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:02:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:40 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:02:40 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:40 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb" returned: 0 in 0.414s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:40 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:02:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:40 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb Jul 21 19:02:40 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:40 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.375s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:41 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:02:41 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb" returned: 0 in 0.350s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:41 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.info Jul 21 19:02:41 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:41 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.info" returned: 0 in 0.270s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:41 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:02:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:41 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.info Jul 21 19:02:41 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:41 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.info" returned: 0 in 0.279s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.538s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:41 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d37e257a-5f86-4597-b8c8-86332b11a388 tempest-GroupSnapshotsTest-273162615 None] group_snapshot ec178082-b78d-4068-881f-a2308d3813cf: created successfully Jul 21 19:02:42 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] group_snapshot ec178082-b78d-4068-881f-a2308d3813cf: deleting Jul 21 19:02:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] group_snapshot ec178082-b78d-4068-881f-a2308d3813cf: deleting {{(pid=87487) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 19:02:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-a48ade7d-ba33-49ef-85d5-1c309c2d07cb" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-a48ade7d-ba33-49ef-85d5-1c309c2d07cb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:42 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Deleting offline snapshot a48ade7d-ba33-49ef-85d5-1c309c2d07cb of volume 4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:02:42 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] snapshot_file for this snap is: volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:02:42 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c01644-ec4e-4278-88b6-a815d33b0768]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:43 devstack sudo[89460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb Jul 21 19:02:43 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:43 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb" returned: 0 in 0.599s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:02:43 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[5333b0d9-3b0a-46b1-8257-bc6c3f7800d7]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:43 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 Jul 21 19:02:43 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:44 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53" returned: 0 in 0.501s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:44 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb Jul 21 19:02:44 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:44 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb" returned: 0 in 0.421s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:44 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb Jul 21 19:02:44 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:44 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53.a48ade7d-ba33-49ef-85d5-1c309c2d07cb" returned: 0 in 0.348s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-a48ade7d-ba33-49ef-85d5-1c309c2d07cb" released by "_delete_snapshot" :: held 2.071s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53" released by "delete_snapshot" :: held 2.103s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:45 devstack cinder-volume[87487]: WARNING cinder.quota [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-937170173 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-937170173, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:02:45 devstack cinder-volume[87487]: WARNING cinder.quota [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-937170173 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-937170173, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:02:45 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] Created reservations ['8a662626-2c5d-4087-b44c-4ff2f31796cc', 'ae283f36-8115-4600-895c-261493d871a9', '51c2286a-c06d-46b3-97ef-a10776a74827', '4c7e8f0a-79d6-4b1b-b5c1-f262f1ba52f9'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:45 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3513dd65-a84e-4f9d-8de5-7fa68d55ba03 tempest-GroupSnapshotsTest-273162615 None] group_snapshot ec178082-b78d-4068-881f-a2308d3813cf: deleted successfully Jul 21 19:02:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "cinder-quobyte-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53" acquired by "delete_volume" :: waited 0.032s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:45 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[348f9d00-5108-40d4-aced-dbaae8c85b32]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:46 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 Jul 21 19:02:46 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:46 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53" returned: 0 in 0.508s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:46 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53 Jul 21 19:02:46 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:46 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53" returned: 0 in 0.280s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Lock "cinder-quobyte-4b5e0842-dd0e-47f6-8c35-4fa0b0cbbc53" released by "delete_volume" :: held 0.893s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:46 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Created reservations ['049f20a1-8403-45f3-85fb-183f21de11e2'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:46 devstack cinder-volume[87487]: WARNING cinder.quota [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-937170173 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-937170173, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:02:46 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Created reservations ['5c9acb9f-f77f-4773-9f53-673479f65e20', 'f3acc07f-5737-4e77-b5b4-186495b8ec72', '4eaa8b1d-a2aa-4627-9d65-85b03525ae14', 'f41190c3-5fb4-4e36-a8a3-cd8e6ec90675'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:47 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:02:47 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:47 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.278s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:47 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:02:47 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3089baec-6c8c-46db-b984-0a91452b47ba tempest-GroupSnapshotsTest-273162615 None] Delete group completed successfully. Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Flow 'volume_create_manager' (4b56f223-6d13-4402-bfb0-6a3b7c5170a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2bb1289-14d0-405e-bc37-7b0cbc32e427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2bb1289-14d0-405e-bc37-7b0cbc32e427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-143423592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a79b168-16a2-4924-b8d6-6ac6e1b3b79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11006afb08349f683a8d68cf4493044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:52Z,use_quota=True,user_id='66c2cac4a9d4471f8e7ea32f728d06d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276c5167-5fde-4a54-b66d-6806d3faee9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276c5167-5fde-4a54-b66d-6806d3faee9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312b8f00-8285-4ff3-9e31-bf3fb76f0358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312b8f00-8285-4ff3-9e31-bf3fb76f0358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a79b168-16a2-4924-b8d6-6ac6e1b3b79a', 'volume_name': 'volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c21651d-5e38-4213-a53b-e2f05ffa61dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c21651d-5e38-4213-a53b-e2f05ffa61dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ab77da-aa02-4734-bc19-c83cbf633cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:52 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Volume 3a79b168-16a2-4924-b8d6-6ac6e1b3b79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a', 'volume_size': 1} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-143423592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a79b168-16a2-4924-b8d6-6ac6e1b3b79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11006afb08349f683a8d68cf4493044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:52Z,use_quota=True,user_id='66c2cac4a9d4471f8e7ea32f728d06d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Creating volume 3a79b168-16a2-4924-b8d6-6ac6e1b3b79a {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:02:52 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:02:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:52 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a 1073741824 Jul 21 19:02:52 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:53 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a 1073741824" returned: 0 in 0.809s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:53 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a Jul 21 19:02:53 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:53 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a" returned: 0 in 0.361s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:02:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ab77da-aa02-4734-bc19-c83cbf633cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d088b267-19a9-4d7e-a258-20bbe779a220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:53 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Volume volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a (3a79b168-16a2-4924-b8d6-6ac6e1b3b79a): created successfully Jul 21 19:02:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d088b267-19a9-4d7e-a258-20bbe779a220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Flow 'volume_create_manager' (4b56f223-6d13-4402-bfb0-6a3b7c5170a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:53 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3ebcf489-21f2-4a1f-90c4-7781353ecae4 tempest-TaggedAttachmentsTest-1364446796 None] Created volume successfully. Jul 21 19:02:56 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4380c372-895a-4ae7-8571-c1969ed51939 tempest-GroupsV314Test-195782825 None] Group tempest-GroupsV314Test-Group-1864589128: creating Jul 21 19:02:56 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4380c372-895a-4ae7-8571-c1969ed51939 tempest-GroupsV314Test-195782825 None] Group tempest-GroupsV314Test-Group-1864589128: created successfully Jul 21 19:02:56 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4380c372-895a-4ae7-8571-c1969ed51939 tempest-GroupsV314Test-195782825 None] Create group completed successfully. Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Flow 'volume_create_manager' (6412966c-a813-462a-8df5-9d9cf9951a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719c889c-030f-4763-80a0-2abf827e6dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719c889c-030f-4763-80a0-2abf827e6dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1190705147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9d605bc-d101-4141-be03-90f58e0c9455,host='devstack@QuobyteHD#QuobyteHD',id=48872ccd-4f93-4b99-955a-285c5e315bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8360e0d2cb414ce6a0ec307a77826fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:59Z,use_quota=True,user_id='a4a83dc0c4104e2eaa2f4c2cf9d959b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c79d84f-b5f5-4a82-bf99-3bfdaacf8ce2),volume_type_id=2c79d84f-b5f5-4a82-bf99-3bfdaacf8ce2)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85428cf4-0526-4754-a7f1-def1aebfdabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85428cf4-0526-4754-a7f1-def1aebfdabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed4dbbe-475f-4108-9ebf-1e6b82a3eb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed4dbbe-475f-4108-9ebf-1e6b82a3eb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48872ccd-4f93-4b99-955a-285c5e315bb5', 'volume_name': 'volume-48872ccd-4f93-4b99-955a-285c5e315bb5', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a382a49-3319-4371-8ee0-e903bb402a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a382a49-3319-4371-8ee0-e903bb402a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80c9673-f31e-47c4-ac18-dd8f512fb246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:58 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Volume 48872ccd-4f93-4b99-955a-285c5e315bb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48872ccd-4f93-4b99-955a-285c5e315bb5', 'volume_size': 1} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f9d605bc-d101-4141-be03-90f58e0c9455,created_at=2026-07-21T17:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1190705147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9d605bc-d101-4141-be03-90f58e0c9455,host='devstack@QuobyteHD#QuobyteHD',id=48872ccd-4f93-4b99-955a-285c5e315bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8360e0d2cb414ce6a0ec307a77826fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:59Z,use_quota=True,user_id='a4a83dc0c4104e2eaa2f4c2cf9d959b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c79d84f-b5f5-4a82-bf99-3bfdaacf8ce2),volume_type_id=2c79d84f-b5f5-4a82-bf99-3bfdaacf8ce2)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Creating volume 48872ccd-4f93-4b99-955a-285c5e315bb5 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:02:58 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:02:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:58 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 1073741824 Jul 21 19:02:58 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:59 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 1073741824" returned: 0 in 0.697s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:59 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 Jul 21 19:02:59 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:00 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5" returned: 0 in 0.821s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:03:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80c9673-f31e-47c4-ac18-dd8f512fb246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48872ccd-4f93-4b99-955a-285c5e315bb5', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67516e3-6d9d-4b2d-bee2-6717b7c4f99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:00 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Volume volume-48872ccd-4f93-4b99-955a-285c5e315bb5 (48872ccd-4f93-4b99-955a-285c5e315bb5): created successfully Jul 21 19:03:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67516e3-6d9d-4b2d-bee2-6717b7c4f99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Flow 'volume_create_manager' (6412966c-a813-462a-8df5-9d9cf9951a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:00 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-72c2f550-599c-4b29-a390-89665089fdcb tempest-GroupsV314Test-195782825 None] Created volume successfully. Jul 21 19:03:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:02 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Cloning volume 48872ccd-4f93-4b99-955a-285c5e315bb5 to volume 66fb01a8-7821-4499-ac49-d0fd53568c83 Jul 21 19:03:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Creating offline snapshot 89754b62-003e-41c8-9a71-24101f1bd611 of volume 48872ccd-4f93-4b99-955a-285c5e315bb5 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:03:02 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9295d3-57bb-447b-80dd-931a08251a3d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:02 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 Jul 21 19:03:03 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:03 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5" returned: 0 in 0.846s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:03 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 1G Jul 21 19:03:03 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:04 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 1G" returned: 0 in 0.614s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48872ccd-4f93-4b99-955a-285c5e315bb5 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:04 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48872ccd-4f93-4b99-955a-285c5e315bb5 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 Jul 21 19:03:04 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:04 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48872ccd-4f93-4b99-955a-285c5e315bb5 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611" returned: 0 in 0.545s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:04 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:03:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:04 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 Jul 21 19:03:04 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:05 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611" returned: 0 in 0.421s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:05 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.info Jul 21 19:03:05 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:05 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.info" returned: 0 in 0.484s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:05 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:03:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:05 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.info Jul 21 19:03:05 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:06 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.info" returned: 0 in 0.472s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Acquiring lock "cinder-quobyte-66fb01a8-7821-4499-ac49-d0fd53568c83" by "_copy_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Lock "cinder-quobyte-66fb01a8-7821-4499-ac49-d0fd53568c83" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] snapshot: 89754b62-003e-41c8-9a71-24101f1bd611, volume: 66fb01a8-7821-4499-ac49-d0fd53568c83, {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[777b13bb-57e2-4d9f-95b5-3ac3d0fb082b]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:06 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 Jul 21 19:03:06 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:06 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611" returned: 0 in 0.473s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48872ccd-4f93-4b99-955a-285c5e315bb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Creating direct copy from snapshot {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[62096bb0-3d3a-4ae5-a84d-a1472bbc1521]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:06 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 Jul 21 19:03:06 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:07 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5" returned: 0 in 0.465s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:07 devstack cinder-volume[87487]: DEBUG cinder.utils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Path /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83 not found in is_blk_device check {{(pid=87487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:03:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:07 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83 Jul 21 19:03:07 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:15 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:UPDATE=52,cinder:SELECT=66,cinder:INSERT=22,cinder:DELETE=3 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:03:15 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:UPDATE=30,cinder:SELECT=28,cinder:INSERT=6 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:03:15 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83" returned: 0 in 8.670s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:15 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7f0ba3-2217-444f-b44a-e74f372d7da4]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:16 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 Jul 21 19:03:16 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Flow 'volume_create_manager' (53927aab-1828-4a10-aa6f-0e23110c7239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6ae009-4303-4eab-8bdb-374fdffc2cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6ae009-4303-4eab-8bdb-374fdffc2cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1676748665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1db75f-bb9d-490b-badc-febd08f6215f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf7f8cf3ccc4eba84a56148f0a53d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:16Z,use_quota=True,user_id='dbeaad035d654081b6d57d5d16c41afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ad92dc-bf95-4c18-a574-01b92568269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ad92dc-bf95-4c18-a574-01b92568269e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b582f07b-6434-4e23-b067-63926085b1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b582f07b-6434-4e23-b067-63926085b1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c1db75f-bb9d-490b-badc-febd08f6215f', 'volume_name': 'volume-9c1db75f-bb9d-490b-badc-febd08f6215f', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06c2e11-9ccc-4ed9-993d-cb7b4711ae79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06c2e11-9ccc-4ed9-993d-cb7b4711ae79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353326d9-a83b-457c-b749-1044bf117a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:16 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Volume 9c1db75f-bb9d-490b-badc-febd08f6215f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c1db75f-bb9d-490b-badc-febd08f6215f', 'volume_size': 1} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:16 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5" returned: 0 in 0.664s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5, size 1024.00 MB, duration 8.67 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:03:16 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Converted 1024.00 MB image at 118.10 MB/s Jul 21 19:03:16 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:16 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83 Jul 21 19:03:16 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:16 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83" returned: 0 in 0.262s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Lock "cinder-quobyte-66fb01a8-7821-4499-ac49-d0fd53568c83" released by "_copy_volume_from_snapshot" :: held 10.629s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Acquiring lock "cinder-quobyte-89754b62-003e-41c8-9a71-24101f1bd611" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Lock "cinder-quobyte-89754b62-003e-41c8-9a71-24101f1bd611" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Deleting offline snapshot 89754b62-003e-41c8-9a71-24101f1bd611 of volume 48872ccd-4f93-4b99-955a-285c5e315bb5 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] snapshot_file for this snap is: volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3c7b7e-67bc-4912-9582-f8886c10b6e1]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:17 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 Jul 21 19:03:17 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:17 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611" returned: 0 in 0.411s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48872ccd-4f93-4b99-955a-285c5e315bb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:03:17 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0342b8f1-bcd1-496a-a690-fc8acb7e4573]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:17 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 Jul 21 19:03:17 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:17 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5" returned: 0 in 0.444s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:17 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 Jul 21 19:03:17 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:18 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611" returned: 0 in 0.415s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:18 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611 Jul 21 19:03:18 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:18 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5.89754b62-003e-41c8-9a71-24101f1bd611" returned: 0 in 0.298s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Lock "cinder-quobyte-89754b62-003e-41c8-9a71-24101f1bd611" released by "_delete_snapshot" :: held 1.701s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.031s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.065s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1676748665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1db75f-bb9d-490b-badc-febd08f6215f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf7f8cf3ccc4eba84a56148f0a53d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:16Z,use_quota=True,user_id='dbeaad035d654081b6d57d5d16c41afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Creating volume 9c1db75f-bb9d-490b-badc-febd08f6215f {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:03:18 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:03:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9c1db75f-bb9d-490b-badc-febd08f6215f 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:18 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9c1db75f-bb9d-490b-badc-febd08f6215f 1073741824 Jul 21 19:03:18 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:18 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-00157c2f-46d0-4ae5-a7fc-f02b8f75cd84 tempest-GroupsV314Test-195782825 None] Create group from source-group-f9d605bc-d101-4141-be03-90f58e0c9455 completed successfully. Jul 21 19:03:19 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9c1db75f-bb9d-490b-badc-febd08f6215f 1073741824" returned: 0 in 0.434s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9c1db75f-bb9d-490b-badc-febd08f6215f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:19 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9c1db75f-bb9d-490b-badc-febd08f6215f Jul 21 19:03:19 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:19 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9c1db75f-bb9d-490b-badc-febd08f6215f" returned: 0 in 0.235s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:03:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353326d9-a83b-457c-b749-1044bf117a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c1db75f-bb9d-490b-badc-febd08f6215f', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10878a98-fe5c-4bb2-b117-389404f2ba8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:19 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Volume volume-9c1db75f-bb9d-490b-badc-febd08f6215f (9c1db75f-bb9d-490b-badc-febd08f6215f): created successfully Jul 21 19:03:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10878a98-fe5c-4bb2-b117-389404f2ba8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Flow 'volume_create_manager' (53927aab-1828-4a10-aa6f-0e23110c7239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:19 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ea4564ee-c19a-402d-b069-4d9c779b5f77 tempest-AttachVolumeShelveTestJSON-914772399 None] Created volume successfully. Jul 21 19:03:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Acquiring lock "cinder-quobyte-66fb01a8-7821-4499-ac49-d0fd53568c83" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Lock "cinder-quobyte-66fb01a8-7821-4499-ac49-d0fd53568c83" acquired by "delete_volume" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:20 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[621e4782-ab22-447f-a784-926db36e97a3]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:20 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83 Jul 21 19:03:20 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:20 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83" returned: 0 in 0.473s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:20 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83 Jul 21 19:03:20 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:21 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-66fb01a8-7821-4499-ac49-d0fd53568c83" returned: 0 in 0.275s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Lock "cinder-quobyte-66fb01a8-7821-4499-ac49-d0fd53568c83" released by "delete_volume" :: held 0.798s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Created reservations ['e823de12-27ce-4a23-8ba3-e20a020f4960'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:03:21 devstack cinder-volume[87487]: WARNING cinder.quota [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1840627192 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1840627192, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:03:21 devstack cinder-volume[87487]: WARNING cinder.quota [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1840627192 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1840627192, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Created reservations ['31d798bd-ae0a-423d-968c-d2d003ab2fa3', 'c0019eb5-7929-4221-adc4-12bb74e27328', 'd5981585-899d-478d-bafd-feeda0733687', '612bd6d4-d0d0-4684-8853-b5a05a7a1afb'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:21 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:03:21 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:21 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.288s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:03:21 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-abe0c91a-552d-414b-9108-632c390d8cc6 tempest-GroupsV314Test-195782825 None] Delete group completed successfully. Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Acquiring lock "cinder-quobyte-48872ccd-4f93-4b99-955a-285c5e315bb5" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Lock "cinder-quobyte-48872ccd-4f93-4b99-955a-285c5e315bb5" acquired by "delete_volume" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[257a057c-8f3a-4b94-bc19-b6a510089849]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:22 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 Jul 21 19:03:22 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:22 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5" returned: 0 in 0.480s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:22 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5 Jul 21 19:03:22 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:22 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-48872ccd-4f93-4b99-955a-285c5e315bb5" returned: 0 in 0.426s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Lock "cinder-quobyte-48872ccd-4f93-4b99-955a-285c5e315bb5" released by "delete_volume" :: held 1.006s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:23 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Created reservations ['2a1a90de-50f8-42b3-a0ac-539c3dbdca4b'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:03:23 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Created reservations ['56a4e0a9-cc43-4904-9955-2a47aaa48335', 'f890ac3f-ab03-4b2b-a472-5bf4054b274c', 'b4dfbba8-2308-46d1-a04c-132cd5a7ecab', 'd80a282a-0363-4d95-afa6-dcddfec46b65'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:03:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:23 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:03:23 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:23 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.328s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:23 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:03:23 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-41b2e3fd-8c10-4aa0-afa4-7f8e3a3115d2 tempest-GroupsV314Test-195782825 None] Delete group completed successfully. Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Flow 'volume_create_manager' (5c8c0792-0f37-4f88-a284-756424d39da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99904a87-0ff5-49ad-9dc9-56b9814707f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99904a87-0ff5-49ad-9dc9-56b9814707f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-273126123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e2e85c-0424-41c2-a3ba-acae6015e041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c876d0dfcbcf47f79a6f0e49ff5e4288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:27Z,use_quota=True,user_id='06091ac2ba1143c4914c3fe65c4a5a99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479bdf63-9205-4472-b71f-9235ae817c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479bdf63-9205-4472-b71f-9235ae817c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413818e0-8f43-4a09-9300-bb1c6845abef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413818e0-8f43-4a09-9300-bb1c6845abef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e2e85c-0424-41c2-a3ba-acae6015e041', 'volume_name': 'volume-72e2e85c-0424-41c2-a3ba-acae6015e041', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac61d01-abd1-469a-b8f7-8a7b53a43a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac61d01-abd1-469a-b8f7-8a7b53a43a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c84214-fc6c-4f57-8369-e9ce2e32046d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:27 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Volume 72e2e85c-0424-41c2-a3ba-acae6015e041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e2e85c-0424-41c2-a3ba-acae6015e041', 'volume_size': 1} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-273126123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e2e85c-0424-41c2-a3ba-acae6015e041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c876d0dfcbcf47f79a6f0e49ff5e4288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:27Z,use_quota=True,user_id='06091ac2ba1143c4914c3fe65c4a5a99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Creating volume 72e2e85c-0424-41c2-a3ba-acae6015e041 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:03:27 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:03:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-72e2e85c-0424-41c2-a3ba-acae6015e041 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:27 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-72e2e85c-0424-41c2-a3ba-acae6015e041 1073741824 Jul 21 19:03:27 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:28 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-72e2e85c-0424-41c2-a3ba-acae6015e041 1073741824" returned: 0 in 0.720s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-72e2e85c-0424-41c2-a3ba-acae6015e041 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:28 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-72e2e85c-0424-41c2-a3ba-acae6015e041 Jul 21 19:03:28 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:28 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-72e2e85c-0424-41c2-a3ba-acae6015e041" returned: 0 in 0.325s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:28 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:03:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c84214-fc6c-4f57-8369-e9ce2e32046d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e2e85c-0424-41c2-a3ba-acae6015e041', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d90022-6fc6-4dde-a533-5ea6ec6520f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:28 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Volume volume-72e2e85c-0424-41c2-a3ba-acae6015e041 (72e2e85c-0424-41c2-a3ba-acae6015e041): created successfully Jul 21 19:03:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d90022-6fc6-4dde-a533-5ea6ec6520f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Flow 'volume_create_manager' (5c8c0792-0f37-4f88-a284-756424d39da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:28 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-edfa47f6-f9ae-4fe4-9cad-c02b9ca36581 tempest-ServerActionsTestOtherA-536694797 None] Created volume successfully. Jul 21 19:03:30 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3646c29f-b375-4cc3-98fa-6041e11e47f6 tempest-GroupsV320Test-1386730268 None] Group tempest-GroupsV320Test-Group-91053532: creating Jul 21 19:03:30 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3646c29f-b375-4cc3-98fa-6041e11e47f6 tempest-GroupsV320Test-1386730268 None] Group tempest-GroupsV320Test-Group-91053532: created successfully Jul 21 19:03:30 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3646c29f-b375-4cc3-98fa-6041e11e47f6 tempest-GroupsV320Test-1386730268 None] Create group completed successfully. Jul 21 19:03:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-80ca463d-41b0-4fa1-b6c3-60c0be55de3f req-48b19331-8862-4d95-a39d-c3d11c5e8452 tempest-AttachVolumeShelveTestJSON-914772399 None] No connector for attachment 8bad7e0f-4339-44ad-8bc9-2cc988a1dacc; skipping storage backend terminate_connection call. {{(pid=87487) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 21 19:03:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-80ca463d-41b0-4fa1-b6c3-60c0be55de3f req-48b19331-8862-4d95-a39d-c3d11c5e8452 tempest-AttachVolumeShelveTestJSON-914772399 None] Deleting attachment 8bad7e0f-4339-44ad-8bc9-2cc988a1dacc. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:03:32 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-368f6545-e6be-4cd4-ba5b-8c6d09011041 tempest-GroupsV320Test-1386730268 None] Created reservations ['0e98fcd1-d1a9-4f7d-9366-7ddc3240a6bc'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:03:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-368f6545-e6be-4cd4-ba5b-8c6d09011041 tempest-GroupsV320Test-1386730268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-368f6545-e6be-4cd4-ba5b-8c6d09011041 tempest-GroupsV320Test-1386730268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-368f6545-e6be-4cd4-ba5b-8c6d09011041 tempest-GroupsV320Test-1386730268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-368f6545-e6be-4cd4-ba5b-8c6d09011041 tempest-GroupsV320Test-1386730268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-368f6545-e6be-4cd4-ba5b-8c6d09011041 tempest-GroupsV320Test-1386730268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-368f6545-e6be-4cd4-ba5b-8c6d09011041 tempest-GroupsV320Test-1386730268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:32 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:03:32 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:33 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-368f6545-e6be-4cd4-ba5b-8c6d09011041 tempest-GroupsV320Test-1386730268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.312s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:33 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-368f6545-e6be-4cd4-ba5b-8c6d09011041 tempest-GroupsV320Test-1386730268 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:03:33 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-368f6545-e6be-4cd4-ba5b-8c6d09011041 tempest-GroupsV320Test-1386730268 None] Delete group completed successfully. Jul 21 19:03:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:03:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:40 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:03:40 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:41 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.495s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:41 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:03:41 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:03:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 8 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:03:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:03:42 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=26,cinder:UPDATE=37,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:03:42 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=33,cinder:UPDATE=31,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:03:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-e1804b89-9528-47ab-b0df-e615add64e1d req-0f0357d6-f452-4d8c-80b4-d018c12954b4 tempest-TaggedAttachmentsTest-1364446796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-e1804b89-9528-47ab-b0df-e615add64e1d req-0f0357d6-f452-4d8c-80b4-d018c12954b4 tempest-TaggedAttachmentsTest-1364446796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-e1804b89-9528-47ab-b0df-e615add64e1d req-0f0357d6-f452-4d8c-80b4-d018c12954b4 tempest-TaggedAttachmentsTest-1364446796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-e1804b89-9528-47ab-b0df-e615add64e1d req-0f0357d6-f452-4d8c-80b4-d018c12954b4 tempest-TaggedAttachmentsTest-1364446796 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b441be94-702e-451f-b195-0b4a2a99ba63', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:03:50 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-e1804b89-9528-47ab-b0df-e615add64e1d req-0f0357d6-f452-4d8c-80b4-d018c12954b4 tempest-TaggedAttachmentsTest-1364446796 None] attachment_update completed successfully. Jul 21 19:03:53 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-c7851313-a57e-488e-b41e-cfc8ecaa308d req-ad3f6d47-9c94-497a-86ff-b4e82b7bcbd4 tempest-TaggedAttachmentsTest-1364446796 None] Terminate volume connection completed successfully. Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-c7851313-a57e-488e-b41e-cfc8ecaa308d req-ad3f6d47-9c94-497a-86ff-b4e82b7bcbd4 tempest-TaggedAttachmentsTest-1364446796 None] Deleting attachment b441be94-702e-451f-b195-0b4a2a99ba63. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Flow 'volume_create_manager' (3d0945c7-72f1-4018-ace4-ac90605e37c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a622b31f-b029-41c8-9be9-d32ccf0d7515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a622b31f-b029-41c8-9be9-d32ccf0d7515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-800566391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f4de59-d2ea-446e-9b10-04ca27c1a69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c4437675554ff78dafa1e1529ec04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:53Z,use_quota=True,user_id='a7e32f514bf642708671dd604e34dc37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c70afc-2009-4fbd-bbd9-2f6a75440253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c70afc-2009-4fbd-bbd9-2f6a75440253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2dcc22-a3af-4eba-893b-1dd50238a0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2dcc22-a3af-4eba-893b-1dd50238a0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f4de59-d2ea-446e-9b10-04ca27c1a69c', 'volume_name': 'volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dbfb6d7-41de-4a3b-8423-84ea80e00351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dbfb6d7-41de-4a3b-8423-84ea80e00351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202421e0-e4de-470b-841d-c762f89f4a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:53 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Volume 64f4de59-d2ea-446e-9b10-04ca27c1a69c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c', 'volume_size': 1} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-800566391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f4de59-d2ea-446e-9b10-04ca27c1a69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c4437675554ff78dafa1e1529ec04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:53Z,use_quota=True,user_id='a7e32f514bf642708671dd604e34dc37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Creating volume 64f4de59-d2ea-446e-9b10-04ca27c1a69c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:03:53 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:53 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c 1073741824 Jul 21 19:03:53 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:53 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c 1073741824" returned: 0 in 0.466s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:54 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c Jul 21 19:03:54 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:54 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c" returned: 0 in 0.335s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:03:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202421e0-e4de-470b-841d-c762f89f4a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735379ce-2b1f-4bae-8d42-f4ca19e1c431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:54 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Volume volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c (64f4de59-d2ea-446e-9b10-04ca27c1a69c): created successfully Jul 21 19:03:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735379ce-2b1f-4bae-8d42-f4ca19e1c431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Flow 'volume_create_manager' (3d0945c7-72f1-4018-ace4-ac90605e37c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:54 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-94c3c9ce-8a50-4d43-9118-118c3e67e15d tempest-VolumesServicesTestJSON-1908138990 None] Created volume successfully. Jul 21 19:03:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Acquiring lock "cinder-64f4de59-d2ea-446e-9b10-04ca27c1a69c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Lock "cinder-64f4de59-d2ea-446e-9b10-04ca27c1a69c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Acquiring lock "cinder-quobyte-64f4de59-d2ea-446e-9b10-04ca27c1a69c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Lock "cinder-quobyte-64f4de59-d2ea-446e-9b10-04ca27c1a69c" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:55 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[263003d1-abc9-479c-8c8a-84887d3f3d65]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:55 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c Jul 21 19:03:55 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:56 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c" returned: 0 in 0.414s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:56 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c Jul 21 19:03:56 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:56 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-64f4de59-d2ea-446e-9b10-04ca27c1a69c" returned: 0 in 0.242s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Lock "cinder-quobyte-64f4de59-d2ea-446e-9b10-04ca27c1a69c" released by "delete_volume" :: held 0.705s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:56 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Created reservations ['f22f52bf-0dd4-42b4-a93d-dc63d5d74ffb', '4314f9bf-a8d8-4dd9-84b1-cd4143bcd619', '4da1f14f-435a-4d1a-9e47-c9d80415ca85', 'efac4359-f2a2-4b0d-bb34-815a43e89ca4'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:03:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:56 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:03:56 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:56 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.304s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:56 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:03:56 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Deleted volume successfully. Jul 21 19:03:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-997a4cf5-d2bb-42ec-9099-f281aa3948d8 tempest-VolumesServicesTestJSON-1908138990 None] Lock "cinder-64f4de59-d2ea-446e-9b10-04ca27c1a69c-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Acquiring lock "cinder-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Lock "cinder-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Acquiring lock "cinder-quobyte-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Lock "cinder-quobyte-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:03 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4febb053-7437-43e9-a14b-e2c57ce3d0a1]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:03 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a Jul 21 19:04:03 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:03 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a" returned: 0 in 0.406s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:03 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a Jul 21 19:04:03 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:03 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a" returned: 0 in 0.272s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Lock "cinder-quobyte-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a" released by "delete_volume" :: held 0.722s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Created reservations ['d385a5cd-0209-427c-a90a-ac5f1690b77c', 'b10194db-f385-4294-9faf-0f0d513db7cb', 'b434a0c3-1b44-4ca8-8c94-4c468b5ca968', '2a397a85-0e0a-4ae6-a4d0-3dd7f988a76f'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:04 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:04:04 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:04 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.343s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:04 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Deleted volume successfully. Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-1c623881-a8b4-4c80-9600-e9b3f3cf1c83 tempest-TaggedAttachmentsTest-1364446796 None] Lock "cinder-3a79b168-16a2-4924-b8d6-6ac6e1b3b79a-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Flow 'volume_create_manager' (1b0ab6df-5743-424b-a4de-e220aa9a1ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fe163e-94d0-4270-9d3b-2d0ca5bfa598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fe163e-94d0-4270-9d3b-2d0ca5bfa598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1188398641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116f01b889f94df0b46f72d1caae3918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:05Z,use_quota=True,user_id='3d9a41df91ce44d5848fc73e7e4f289a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f33ad1-5fa1-421d-8205-019daec04270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f33ad1-5fa1-421d-8205-019daec04270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d2d094-75be-4e78-87e2-cba1bc1d7242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d2d094-75be-4e78-87e2-cba1bc1d7242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d', 'volume_name': 'volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61b8a4e-0565-42cb-89cd-cd1b519ae46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61b8a4e-0565-42cb-89cd-cd1b519ae46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b1afd2-17bf-4673-9ac4-bc36e96225b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:04 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Volume 9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d', 'volume_size': 1} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1188398641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116f01b889f94df0b46f72d1caae3918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:05Z,use_quota=True,user_id='3d9a41df91ce44d5848fc73e7e4f289a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Creating volume 9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:04:04 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:04 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d 1073741824 Jul 21 19:04:04 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-9eb93545-a7e6-48aa-8079-7b9b6580d780 req-b2c04199-af37-43a7-b048-0eeb3a439254 tempest-ServerActionsTestOtherA-536694797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:05 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d 1073741824" returned: 0 in 0.452s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:05 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d Jul 21 19:04:05 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:05 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d" returned: 0 in 0.247s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:04:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-9eb93545-a7e6-48aa-8079-7b9b6580d780 req-b2c04199-af37-43a7-b048-0eeb3a439254 tempest-ServerActionsTestOtherA-536694797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.537s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b1afd2-17bf-4673-9ac4-bc36e96225b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed20439-532f-4563-b2fb-a5c0b095a20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-9eb93545-a7e6-48aa-8079-7b9b6580d780 req-b2c04199-af37-43a7-b048-0eeb3a439254 tempest-ServerActionsTestOtherA-536694797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:05 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Volume volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d (9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d): created successfully Jul 21 19:04:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed20439-532f-4563-b2fb-a5c0b095a20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Flow 'volume_create_manager' (1b0ab6df-5743-424b-a4de-e220aa9a1ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-95700dc6-f186-4f24-8201-8edbfa93716c tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Created volume successfully. Jul 21 19:04:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-9eb93545-a7e6-48aa-8079-7b9b6580d780 req-b2c04199-af37-43a7-b048-0eeb3a439254 tempest-ServerActionsTestOtherA-536694797 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-72e2e85c-0424-41c2-a3ba-acae6015e041', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df38a60b-708e-449a-a6d7-4db9cc4743e8', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:04:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-9eb93545-a7e6-48aa-8079-7b9b6580d780 req-b2c04199-af37-43a7-b048-0eeb3a439254 tempest-ServerActionsTestOtherA-536694797 None] attachment_update completed successfully. Jul 21 19:04:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Creating offline snapshot 136c961d-2ffa-45b3-aa93-33bde0d3d6fe of volume 9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:04:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[720fd93d-327d-402a-8971-ff04c19fbb3b]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:07 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d Jul 21 19:04:07 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:07 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d" returned: 0 in 0.381s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:07 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe 1G Jul 21 19:04:07 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:08 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe 1G" returned: 0 in 0.651s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:08 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe Jul 21 19:04:08 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:08 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe" returned: 0 in 0.504s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:08 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe is being set with open permissions: ugo+rw Jul 21 19:04:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:08 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe Jul 21 19:04:08 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:08 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe" returned: 0 in 0.331s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:08 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.info Jul 21 19:04:08 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:09 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.info" returned: 0 in 0.495s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:09 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.info is being set with open permissions: ugo+rw Jul 21 19:04:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:09 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-2433e768-a6b0-44a2-9121-bafa6e09d42a req-9318ce73-a5ee-41ec-a252-0cb14717093b tempest-ServerActionsTestOtherA-536694797 None] Terminate volume connection completed successfully. Jul 21 19:04:09 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-2433e768-a6b0-44a2-9121-bafa6e09d42a req-9318ce73-a5ee-41ec-a252-0cb14717093b tempest-ServerActionsTestOtherA-536694797 None] Deleting attachment df38a60b-708e-449a-a6d7-4db9cc4743e8. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:04:09 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.info Jul 21 19:04:09 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:09 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.info" returned: 0 in 0.420s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.947s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:09 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-69a0a23c-214b-4ef2-8dc3-8ef091adb24e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Create snapshot completed successfully Jul 21 19:04:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-2433e768-a6b0-44a2-9121-bafa6e09d42a req-debfe95e-1f1e-48c7-b9fc-e5644009f3c5 tempest-ServerActionsTestOtherA-536694797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-2433e768-a6b0-44a2-9121-bafa6e09d42a req-debfe95e-1f1e-48c7-b9fc-e5644009f3c5 tempest-ServerActionsTestOtherA-536694797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-2433e768-a6b0-44a2-9121-bafa6e09d42a req-debfe95e-1f1e-48c7-b9fc-e5644009f3c5 tempest-ServerActionsTestOtherA-536694797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-2433e768-a6b0-44a2-9121-bafa6e09d42a req-debfe95e-1f1e-48c7-b9fc-e5644009f3c5 tempest-ServerActionsTestOtherA-536694797 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-72e2e85c-0424-41c2-a3ba-acae6015e041', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff486423-ab8f-4274-9c9e-10dbcbab6319', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:04:10 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-2433e768-a6b0-44a2-9121-bafa6e09d42a req-debfe95e-1f1e-48c7-b9fc-e5644009f3c5 tempest-ServerActionsTestOtherA-536694797 None] attachment_update completed successfully. Jul 21 19:04:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Acquiring lock "cinder-136c961d-2ffa-45b3-aa93-33bde0d3d6fe-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "cinder-136c961d-2ffa-45b3-aa93-33bde0d3d6fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Acquiring lock "cinder-quobyte-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "cinder-quobyte-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Acquiring lock "cinder-quobyte-136c961d-2ffa-45b3-aa93-33bde0d3d6fe" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "cinder-quobyte-136c961d-2ffa-45b3-aa93-33bde0d3d6fe" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Deleting offline snapshot 136c961d-2ffa-45b3-aa93-33bde0d3d6fe of volume 9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:04:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] snapshot_file for this snap is: volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:04:11 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2560e070-a556-42ca-a1c0-53dfa09e561f]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:11 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe Jul 21 19:04:11 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:12 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe" returned: 0 in 0.613s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:04:12 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c955dada-5063-4225-a760-1d9956f93d71]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:12 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d Jul 21 19:04:12 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:12 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d" returned: 0 in 0.629s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:12 devstack sudo[91508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe Jul 21 19:04:12 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:13 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe" returned: 0 in 0.832s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:13 devstack sudo[91855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe Jul 21 19:04:13 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:14 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d.136c961d-2ffa-45b3-aa93-33bde0d3d6fe" returned: 0 in 0.557s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "cinder-quobyte-136c961d-2ffa-45b3-aa93-33bde0d3d6fe" released by "_delete_snapshot" :: held 2.839s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "cinder-quobyte-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d" released by "delete_snapshot" :: held 2.877s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:14 devstack cinder-volume[87487]: WARNING cinder.quota [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:04:14 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Created reservations ['ca91b13c-5568-4fd8-ab47-2a79a3a0197f', '3d1bf1f0-6115-4c4a-80b8-3a2da27890ab', 'ec86ab02-bfb9-428c-b3fc-b7b4dab4befd', '7a561bff-e7bd-4a69-94e7-734c84e63e19'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:14 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Delete snapshot completed successfully. Jul 21 19:04:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-04f57ae8-fe6f-467e-8873-1649bcbc9dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "cinder-136c961d-2ffa-45b3-aa93-33bde0d3d6fe-delete_snapshot" released by "delete_snapshot" :: held 3.226s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Acquiring lock "cinder-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "cinder-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Acquiring lock "cinder-quobyte-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "cinder-quobyte-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d" acquired by "delete_volume" :: waited 0.044s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:15 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[62368aec-0645-45d9-94cc-19ca08238d2d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:15 devstack sudo[91880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d Jul 21 19:04:15 devstack sudo[91880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:16 devstack sudo[91880]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d" returned: 0 in 1.022s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:16 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d Jul 21 19:04:16 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Acquiring lock "cinder-9c1db75f-bb9d-490b-badc-febd08f6215f-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Lock "cinder-9c1db75f-bb9d-490b-badc-febd08f6215f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:16 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d" returned: 0 in 0.370s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "cinder-quobyte-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d" released by "delete_volume" :: held 1.566s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Acquiring lock "cinder-quobyte-9c1db75f-bb9d-490b-badc-febd08f6215f" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Lock "cinder-quobyte-9c1db75f-bb9d-490b-badc-febd08f6215f" acquired by "delete_volume" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8994fc0a-15ce-4dc4-aeb5-45ff157acecc]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9c1db75f-bb9d-490b-badc-febd08f6215f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Created reservations ['ef61d2c0-aa9c-4203-9fac-78282dfa66a0', '22112e93-9f82-4400-8dcc-b42f71dafc6b', '21ae8429-8114-40b3-b3ae-ce2b71ab6252', '327b7765-9380-4052-878a-a9727409e5ac'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:16 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9c1db75f-bb9d-490b-badc-febd08f6215f Jul 21 19:04:16 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:16 devstack sudo[91891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:04:16 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:17 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9c1db75f-bb9d-490b-badc-febd08f6215f" returned: 0 in 0.566s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9c1db75f-bb9d-490b-badc-febd08f6215f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:17 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9c1db75f-bb9d-490b-badc-febd08f6215f Jul 21 19:04:17 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:17 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.488s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:17 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:17 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Deleted volume successfully. Jul 21 19:04:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b24c3efb-845f-4a09-a881-9bdc0ea7443e tempest-VolumeSnapshotQuotasNegativeTestJSON-1811474392 None] Lock "cinder-9971381d-a9ed-4fc1-a4e9-e21f2ddbf48d-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:17 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9c1db75f-bb9d-490b-badc-febd08f6215f" returned: 0 in 0.426s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Lock "cinder-quobyte-9c1db75f-bb9d-490b-badc-febd08f6215f" released by "delete_volume" :: held 1.059s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:17 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Created reservations ['fc9bdcb3-a4b3-41fc-a2ce-2968da3e4ce8', 'b20146c2-65a7-466c-9c42-176fb0859f42', '5bac2119-2ce0-4d2a-b095-4bed94861f4c', '0c101b3c-d94c-4984-b3bd-95b3a9483af5'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:18 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:04:18 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:18 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.313s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:18 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:18 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Deleted volume successfully. Jul 21 19:04:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d31bd8e2-4cf7-4812-bc8d-adfda6b877b8 tempest-AttachVolumeShelveTestJSON-914772399 None] Lock "cinder-9c1db75f-bb9d-490b-badc-febd08f6215f-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:28 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=60,cinder:UPDATE=47,cinder:INSERT=8 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:04:28 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=49,cinder:UPDATE=52,cinder:INSERT=15,cinder:DELETE=7 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Flow 'volume_create_manager' (e236cb5b-bfdf-4b10-b52b-4c602d980ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0359448a-4fca-463d-967e-4a96a0294459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0359448a-4fca-463d-967e-4a96a0294459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-660405777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4434adb-1892-4929-9575-0a5d3c3f0507,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea5ecf7947e34f22bd29a0b2bb183b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:30Z,use_quota=True,user_id='8f84e52b0d4544d29bf5e317a2729b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1303e0-e52a-4685-94e5-42dc13a0023f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1303e0-e52a-4685-94e5-42dc13a0023f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f4d083-2bc1-4b52-af16-7edf38710299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f4d083-2bc1-4b52-af16-7edf38710299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4434adb-1892-4929-9575-0a5d3c3f0507', 'volume_name': 'volume-d4434adb-1892-4929-9575-0a5d3c3f0507', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e281e39f-19b9-42c4-8aa2-7d674f76b39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e281e39f-19b9-42c4-8aa2-7d674f76b39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3deb46f-a902-4e4f-9e7e-57e20c369669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:29 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Volume d4434adb-1892-4929-9575-0a5d3c3f0507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4434adb-1892-4929-9575-0a5d3c3f0507', 'volume_size': 1} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-660405777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4434adb-1892-4929-9575-0a5d3c3f0507,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea5ecf7947e34f22bd29a0b2bb183b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:30Z,use_quota=True,user_id='8f84e52b0d4544d29bf5e317a2729b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Creating volume d4434adb-1892-4929-9575-0a5d3c3f0507 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:04:29 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:04:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4434adb-1892-4929-9575-0a5d3c3f0507 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:29 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4434adb-1892-4929-9575-0a5d3c3f0507 1073741824 Jul 21 19:04:29 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:30 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4434adb-1892-4929-9575-0a5d3c3f0507 1073741824" returned: 0 in 0.578s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4434adb-1892-4929-9575-0a5d3c3f0507 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:30 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4434adb-1892-4929-9575-0a5d3c3f0507 Jul 21 19:04:30 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:30 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4434adb-1892-4929-9575-0a5d3c3f0507" returned: 0 in 0.288s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:04:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3deb46f-a902-4e4f-9e7e-57e20c369669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4434adb-1892-4929-9575-0a5d3c3f0507', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e347465-d0ef-4b9a-b3e3-478a2a839988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:30 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Volume volume-d4434adb-1892-4929-9575-0a5d3c3f0507 (d4434adb-1892-4929-9575-0a5d3c3f0507): created successfully Jul 21 19:04:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e347465-d0ef-4b9a-b3e3-478a2a839988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Flow 'volume_create_manager' (e236cb5b-bfdf-4b10-b52b-4c602d980ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:30 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2fe48273-f9f9-478a-a294-0434ac4b4c96 tempest-VolumesTestJSON-1875551803 None] Created volume successfully. Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Flow 'volume_create_manager' (2bc124e5-39c4-4b6e-bf98-80576b649e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0158cc-4835-4389-a71f-5cd92b679cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0158cc-4835-4389-a71f-5cd92b679cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1542869534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01858bd2-e5b7-4772-9196-0939483f6a18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea5ecf7947e34f22bd29a0b2bb183b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:33Z,use_quota=True,user_id='8f84e52b0d4544d29bf5e317a2729b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3467f0-404a-4a72-94cb-8a9af78f6658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3467f0-404a-4a72-94cb-8a9af78f6658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f204fcfb-f5a6-4f4f-aefd-8421a5f6ae30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f204fcfb-f5a6-4f4f-aefd-8421a5f6ae30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01858bd2-e5b7-4772-9196-0939483f6a18', 'volume_name': 'volume-01858bd2-e5b7-4772-9196-0939483f6a18', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b67aa85-f16e-442b-ae53-8dd7310bbdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b67aa85-f16e-442b-ae53-8dd7310bbdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba199740-d747-4fec-8280-e190633412e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:32 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Volume 01858bd2-e5b7-4772-9196-0939483f6a18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01858bd2-e5b7-4772-9196-0939483f6a18', 'volume_size': 1} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1542869534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01858bd2-e5b7-4772-9196-0939483f6a18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea5ecf7947e34f22bd29a0b2bb183b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:33Z,use_quota=True,user_id='8f84e52b0d4544d29bf5e317a2729b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Creating volume 01858bd2-e5b7-4772-9196-0939483f6a18 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:04:32 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:04:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-01858bd2-e5b7-4772-9196-0939483f6a18 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:32 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-01858bd2-e5b7-4772-9196-0939483f6a18 1073741824 Jul 21 19:04:32 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:33 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-01858bd2-e5b7-4772-9196-0939483f6a18 1073741824" returned: 0 in 0.600s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-01858bd2-e5b7-4772-9196-0939483f6a18 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:33 devstack sudo[91988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-01858bd2-e5b7-4772-9196-0939483f6a18 Jul 21 19:04:33 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:33 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-01858bd2-e5b7-4772-9196-0939483f6a18" returned: 0 in 0.262s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:04:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba199740-d747-4fec-8280-e190633412e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01858bd2-e5b7-4772-9196-0939483f6a18', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34240b7-c635-45fd-acd0-33d356a52e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:33 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Volume volume-01858bd2-e5b7-4772-9196-0939483f6a18 (01858bd2-e5b7-4772-9196-0939483f6a18): created successfully Jul 21 19:04:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34240b7-c635-45fd-acd0-33d356a52e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Flow 'volume_create_manager' (2bc124e5-39c4-4b6e-bf98-80576b649e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:33 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b0db04b7-f36a-4b39-9f88-1c9562e2d746 tempest-VolumesTestJSON-1875551803 None] Created volume successfully. Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Flow 'volume_create_manager' (a591e517-c7ed-4d65-b344-e3d665604d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114aa4ef-d7ae-402f-9ab0-ea5b5e71f669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114aa4ef-d7ae-402f-9ab0-ea5b5e71f669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1915115696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544f3536-e2b4-4bde-adb8-aa4b00358e8c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea5ecf7947e34f22bd29a0b2bb183b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:35Z,use_quota=True,user_id='8f84e52b0d4544d29bf5e317a2729b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4365236-0cb7-4b92-9b78-624e5e1b73cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4365236-0cb7-4b92-9b78-624e5e1b73cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844eab7d-c11c-46c7-93f3-6beaec9d0237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844eab7d-c11c-46c7-93f3-6beaec9d0237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544f3536-e2b4-4bde-adb8-aa4b00358e8c', 'volume_name': 'volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61c199f-d876-4f2f-8757-c095775e587a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61c199f-d876-4f2f-8757-c095775e587a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07df984c-dd22-46b8-9861-9b325cd4b30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:35 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Volume 544f3536-e2b4-4bde-adb8-aa4b00358e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c', 'volume_size': 1} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1915115696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544f3536-e2b4-4bde-adb8-aa4b00358e8c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea5ecf7947e34f22bd29a0b2bb183b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:35Z,use_quota=True,user_id='8f84e52b0d4544d29bf5e317a2729b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Creating volume 544f3536-e2b4-4bde-adb8-aa4b00358e8c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:04:35 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:04:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:35 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c 1073741824 Jul 21 19:04:35 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:35 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c 1073741824" returned: 0 in 0.580s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:36 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c Jul 21 19:04:36 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:36 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c" returned: 0 in 0.316s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:04:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07df984c-dd22-46b8-9861-9b325cd4b30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1319097b-2c6b-4578-af9d-305575e3c478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:36 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Volume volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c (544f3536-e2b4-4bde-adb8-aa4b00358e8c): created successfully Jul 21 19:04:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1319097b-2c6b-4578-af9d-305575e3c478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Flow 'volume_create_manager' (a591e517-c7ed-4d65-b344-e3d665604d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:36 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-8e7d810e-c5a6-4497-bc65-5e1a93dccdf7 tempest-VolumesTestJSON-1875551803 None] Created volume successfully. Jul 21 19:04:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Acquiring lock "cinder-544f3536-e2b4-4bde-adb8-aa4b00358e8c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Lock "cinder-544f3536-e2b4-4bde-adb8-aa4b00358e8c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Acquiring lock "cinder-quobyte-544f3536-e2b4-4bde-adb8-aa4b00358e8c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Lock "cinder-quobyte-544f3536-e2b4-4bde-adb8-aa4b00358e8c" acquired by "delete_volume" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:39 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[72afb2c1-91bf-44b8-89e8-2d080360dda8]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:39 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c Jul 21 19:04:39 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:39 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c" returned: 0 in 0.478s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:39 devstack sudo[92029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c Jul 21 19:04:39 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:40 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-544f3536-e2b4-4bde-adb8-aa4b00358e8c" returned: 0 in 0.393s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Lock "cinder-quobyte-544f3536-e2b4-4bde-adb8-aa4b00358e8c" released by "delete_volume" :: held 0.921s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Created reservations ['8b54052d-ddee-4886-a463-f1d183ec43d9', '85047ad6-011d-4bd5-867b-2151841d8e1f', '0564a872-716f-4019-978c-abb650566622', 'ffad15ef-1251-48a8-8e19-65a5e0729af6'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:40 devstack sudo[92034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:04:40 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:40 devstack sudo[92038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:04:40 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:40 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.349s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:40 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Deleted volume successfully. Jul 21 19:04:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4e2f1a64-6ba0-4afc-b88f-75d8e2226a07 tempest-VolumesTestJSON-1875551803 None] Lock "cinder-544f3536-e2b4-4bde-adb8-aa4b00358e8c-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:41 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.458s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:41 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:41 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:04:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 8 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:04:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:04:41 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Acquiring lock "cinder-01858bd2-e5b7-4772-9196-0939483f6a18-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:41 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Lock "cinder-01858bd2-e5b7-4772-9196-0939483f6a18-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:41 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Acquiring lock "cinder-quobyte-01858bd2-e5b7-4772-9196-0939483f6a18" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:41 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Lock "cinder-quobyte-01858bd2-e5b7-4772-9196-0939483f6a18" acquired by "delete_volume" :: waited 0.033s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:41 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c453ddc-48cb-43a3-b152-c05cbd08dac8]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-01858bd2-e5b7-4772-9196-0939483f6a18 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:42 devstack sudo[92044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-01858bd2-e5b7-4772-9196-0939483f6a18 Jul 21 19:04:42 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:42 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-92fffac6-bfe2-4d23-a793-1d24ac8a267b req-b181f775-53b0-4119-ab99-32a9e4f8835e tempest-ServerActionsTestOtherA-536694797 None] Terminate volume connection completed successfully. Jul 21 19:04:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-92fffac6-bfe2-4d23-a793-1d24ac8a267b req-b181f775-53b0-4119-ab99-32a9e4f8835e tempest-ServerActionsTestOtherA-536694797 None] Deleting attachment ff486423-ab8f-4274-9c9e-10dbcbab6319. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:04:42 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-01858bd2-e5b7-4772-9196-0939483f6a18" returned: 0 in 0.867s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-01858bd2-e5b7-4772-9196-0939483f6a18 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:42 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-01858bd2-e5b7-4772-9196-0939483f6a18 Jul 21 19:04:42 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:43 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-01858bd2-e5b7-4772-9196-0939483f6a18" returned: 0 in 0.519s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Lock "cinder-quobyte-01858bd2-e5b7-4772-9196-0939483f6a18" released by "delete_volume" :: held 1.475s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:43 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Created reservations ['cdd4b4c7-37d1-4d84-a9c9-f902373bda08', 'ba159892-3869-4ecb-a92f-433099deae2c', '7ba7020a-7f18-4347-bd5a-11149f9b2ba2', 'b672aa05-a219-4d62-ae39-37fffc2163ad'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:43 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:04:43 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:44 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.617s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:44 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:44 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Deleted volume successfully. Jul 21 19:04:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2555d4bd-1b3f-43be-9088-123b07df68dd tempest-VolumesTestJSON-1875551803 None] Lock "cinder-01858bd2-e5b7-4772-9196-0939483f6a18-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Acquiring lock "cinder-d4434adb-1892-4929-9575-0a5d3c3f0507-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Lock "cinder-d4434adb-1892-4929-9575-0a5d3c3f0507-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Acquiring lock "cinder-quobyte-d4434adb-1892-4929-9575-0a5d3c3f0507" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Lock "cinder-quobyte-d4434adb-1892-4929-9575-0a5d3c3f0507" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:44 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca795e1-1495-4ffc-8540-56913b0a5b76]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4434adb-1892-4929-9575-0a5d3c3f0507 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:44 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4434adb-1892-4929-9575-0a5d3c3f0507 Jul 21 19:04:44 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:44 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4434adb-1892-4929-9575-0a5d3c3f0507" returned: 0 in 0.623s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4434adb-1892-4929-9575-0a5d3c3f0507 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:44 devstack sudo[92111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4434adb-1892-4929-9575-0a5d3c3f0507 Jul 21 19:04:44 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:45 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4434adb-1892-4929-9575-0a5d3c3f0507" returned: 0 in 0.492s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Lock "cinder-quobyte-d4434adb-1892-4929-9575-0a5d3c3f0507" released by "delete_volume" :: held 1.228s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:45 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Created reservations ['9462df78-5fcf-4ef7-822a-7c0ff6e318c4', '18238f12-b2a3-4a07-9ddf-1aa82acf7301', '630bd781-7562-4218-98b8-c61795101a21', '87f465be-0679-48f4-b7e5-0e40df2d0f77'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:45 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:04:45 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:45 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.320s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:45 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:45 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Deleted volume successfully. Jul 21 19:04:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5dee2f15-b79e-4d86-8dd2-a30e0fa854f3 tempest-VolumesTestJSON-1875551803 None] Lock "cinder-d4434adb-1892-4929-9575-0a5d3c3f0507-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Acquiring lock "cinder-72e2e85c-0424-41c2-a3ba-acae6015e041-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Lock "cinder-72e2e85c-0424-41c2-a3ba-acae6015e041-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Acquiring lock "cinder-quobyte-72e2e85c-0424-41c2-a3ba-acae6015e041" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Lock "cinder-quobyte-72e2e85c-0424-41c2-a3ba-acae6015e041" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:51 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7223d029-8391-4188-a0a6-b314f4f02b33]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-72e2e85c-0424-41c2-a3ba-acae6015e041 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:52 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-72e2e85c-0424-41c2-a3ba-acae6015e041 Jul 21 19:04:52 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:52 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-72e2e85c-0424-41c2-a3ba-acae6015e041" returned: 0 in 0.627s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-72e2e85c-0424-41c2-a3ba-acae6015e041 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:52 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-72e2e85c-0424-41c2-a3ba-acae6015e041 Jul 21 19:04:52 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:53 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-72e2e85c-0424-41c2-a3ba-acae6015e041" returned: 0 in 0.843s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Lock "cinder-quobyte-72e2e85c-0424-41c2-a3ba-acae6015e041" released by "delete_volume" :: held 1.552s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:53 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Created reservations ['f8f34dec-5bbc-47e0-8be5-5ab79677ce62', '7ca26a30-9c77-4ece-a1b0-71b7300de585', '96c10812-0e71-49b0-a0d2-7c4ec6abd740', 'ae29cbc6-760b-491d-a223-d0ef7ec40723'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:53 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:04:53 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:54 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.923s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:54 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:54 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Deleted volume successfully. Jul 21 19:04:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-20fd9a40-1920-41cc-849f-9e3e2debf2fb tempest-ServerActionsTestOtherA-536694797 None] Lock "cinder-72e2e85c-0424-41c2-a3ba-acae6015e041-delete_volume" released by "delete_volume" :: held 2.839s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:03 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:UPDATE=38,cinder:SELECT=25,cinder:DELETE=3,cinder:INSERT=9 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:05:04 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=30,cinder:INSERT=10,cinder:UPDATE=45,cinder:DELETE=4 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Flow 'volume_create_manager' (d9c849f1-b849-4d9e-9e17-fbc67aac480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570b9a34-8a50-4623-a946-5b1e1423eb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570b9a34-8a50-4623-a946-5b1e1423eb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1117210997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e98c0d-d613-4e91-9bf4-f841cc080bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305e37b67b9c41699f5d31cde61fd80e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:10Z,use_quota=True,user_id='ba0f5cf054304e759924283b072d945c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f01075-522e-4df3-8f36-360b4b238939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f01075-522e-4df3-8f36-360b4b238939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90cb234d-ad78-426d-a70b-53838025ef2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90cb234d-ad78-426d-a70b-53838025ef2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e98c0d-d613-4e91-9bf4-f841cc080bad', 'volume_name': 'volume-44e98c0d-d613-4e91-9bf4-f841cc080bad', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93a10a3-0c23-4a11-8d9c-c6e56dfe3591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93a10a3-0c23-4a11-8d9c-c6e56dfe3591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bec36b3-3f56-465b-ac2b-001ceb55ea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:10 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Volume 44e98c0d-d613-4e91-9bf4-f841cc080bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e98c0d-d613-4e91-9bf4-f841cc080bad', 'volume_size': 1} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1117210997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e98c0d-d613-4e91-9bf4-f841cc080bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305e37b67b9c41699f5d31cde61fd80e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:10Z,use_quota=True,user_id='ba0f5cf054304e759924283b072d945c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Creating volume 44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:10 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:05:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:10 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad 1073741824 Jul 21 19:05:10 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:11 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad 1073741824" returned: 0 in 0.755s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:11 devstack sudo[92422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad Jul 21 19:05:11 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:11 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad" returned: 0 in 0.451s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bec36b3-3f56-465b-ac2b-001ceb55ea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e98c0d-d613-4e91-9bf4-f841cc080bad', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b36287-fd87-4db8-9809-d9e03ba08666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:11 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Volume volume-44e98c0d-d613-4e91-9bf4-f841cc080bad (44e98c0d-d613-4e91-9bf4-f841cc080bad): created successfully Jul 21 19:05:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b36287-fd87-4db8-9809-d9e03ba08666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Flow 'volume_create_manager' (d9c849f1-b849-4d9e-9e17-fbc67aac480d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:11 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4b9ef03a-3b00-409a-8c7a-ffd6fb210354 tempest-SnapshotsActionsTest-1121244827 None] Created volume successfully. Jul 21 19:05:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] Creating offline snapshot 3033cf22-d6f9-4d36-8a95-49bd82b5656f of volume 44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:05:12 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[050ce4ed-cd35-488d-ac8e-ec78e366f96e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:12 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad Jul 21 19:05:12 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:13 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad" returned: 0 in 0.534s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:13 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f 1G Jul 21 19:05:13 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:13 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f 1G" returned: 0 in 0.799s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:13 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f Jul 21 19:05:13 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:14 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f" returned: 0 in 0.544s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:14 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f is being set with open permissions: ugo+rw Jul 21 19:05:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:14 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f Jul 21 19:05:14 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:14 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f" returned: 0 in 0.541s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:15 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.info Jul 21 19:05:15 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:15 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.info" returned: 0 in 0.457s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:15 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.info is being set with open permissions: ugo+rw Jul 21 19:05:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:15 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.info Jul 21 19:05:15 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:16 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.info" returned: 0 in 0.506s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.583s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:16 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-62ed5ea6-3d43-452a-9d3c-db6e1b45bf72 tempest-SnapshotsActionsTest-1121244827 None] Create snapshot completed successfully Jul 21 19:05:16 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Flow 'volume_create_manager' (7f3710f4-88ab-4f7a-a389-9a148c788d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00f0548-d7b2-49cb-9cf6-b8d6483b1411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00f0548-d7b2-49cb-9cf6-b8d6483b1411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1608969693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62821ac7-3e7a-44c0-968d-0dfa04ad182e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18e62b70509491997e5dc289bc2aff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:17Z,use_quota=True,user_id='8332505bc85c4016b7e72394ab519877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083ad712-7456-445b-a2f9-df17c7748707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083ad712-7456-445b-a2f9-df17c7748707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ddf430-a30b-4071-b1e3-561580b8065c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ddf430-a30b-4071-b1e3-561580b8065c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62821ac7-3e7a-44c0-968d-0dfa04ad182e', 'volume_name': 'volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355dbb30-b993-4a5c-a763-e279f401d47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355dbb30-b993-4a5c-a763-e279f401d47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d899ff-d366-47a7-90d1-59cf27a37bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:17 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Volume 62821ac7-3e7a-44c0-968d-0dfa04ad182e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e', 'volume_size': 1} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1608969693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62821ac7-3e7a-44c0-968d-0dfa04ad182e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18e62b70509491997e5dc289bc2aff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:17Z,use_quota=True,user_id='8332505bc85c4016b7e72394ab519877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Creating volume 62821ac7-3e7a-44c0-968d-0dfa04ad182e {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:17 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:05:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:17 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e 1073741824 Jul 21 19:05:17 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:18 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e 1073741824" returned: 0 in 1.197s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:18 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e Jul 21 19:05:18 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:19 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e" returned: 0 in 0.624s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.714s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] Creating offline snapshot 7dd9098e-ee07-44ef-b70a-1a0520d9b9fa of volume 44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:05:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d899ff-d366-47a7-90d1-59cf27a37bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9426299a-fdcc-437d-ad1a-413533b47f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:19 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d14c4bd-c602-438c-9859-349d9eef7e9d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:19 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Volume volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e (62821ac7-3e7a-44c0-968d-0dfa04ad182e): created successfully Jul 21 19:05:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9426299a-fdcc-437d-ad1a-413533b47f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Flow 'volume_create_manager' (7f3710f4-88ab-4f7a-a389-9a148c788d9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:19 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4499a3ad-18c0-4f77-be79-33424eee9302 tempest-ServerRescueNegativeTestJSON-1740397736 None] Created volume successfully. Jul 21 19:05:19 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f Jul 21 19:05:19 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:20 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f" returned: 0 in 0.765s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e98c0d-d613-4e91-9bf4-f841cc080bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:20 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa 1G Jul 21 19:05:20 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:20 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Flow 'volume_create_manager' (ff4dc69e-a711-4ed5-9e21-55055d8b3d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864ce6f2-329e-4ff4-ad02-c8c31c1840e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864ce6f2-329e-4ff4-ad02-c8c31c1840e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-548010730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b8e57c-ff72-4338-8211-6711bcad4d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0e9f2769ec4a77a7b25fcb2afd0b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:20Z,use_quota=True,user_id='9c2ec2beb90f4218be9ba445961c62bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53d7a1e-291d-4a71-be03-630bae59b605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53d7a1e-291d-4a71-be03-630bae59b605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63f9243-3db8-4a0d-b0b2-aaca19148209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63f9243-3db8-4a0d-b0b2-aaca19148209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04b8e57c-ff72-4338-8211-6711bcad4d90', 'volume_name': 'volume-04b8e57c-ff72-4338-8211-6711bcad4d90', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b52906-9677-4c88-975c-0cbf0702ced1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b52906-9677-4c88-975c-0cbf0702ced1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30969cab-0f27-4b61-afbb-6a5123ac0e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:21 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Volume 04b8e57c-ff72-4338-8211-6711bcad4d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04b8e57c-ff72-4338-8211-6711bcad4d90', 'volume_size': 1} Jul 21 19:05:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:21 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa 1G" returned: 0 in 1.719s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:21 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa Jul 21 19:05:21 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:22 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa" returned: 0 in 0.733s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:22 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa is being set with open permissions: ugo+rw Jul 21 19:05:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:22 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa Jul 21 19:05:22 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:23 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa" returned: 0 in 0.728s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.179s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.198s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-548010730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b8e57c-ff72-4338-8211-6711bcad4d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0e9f2769ec4a77a7b25fcb2afd0b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:20Z,use_quota=True,user_id='9c2ec2beb90f4218be9ba445961c62bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Creating volume 04b8e57c-ff72-4338-8211-6711bcad4d90 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:23 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:05:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:23 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90 1073741824 Jul 21 19:05:23 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:23 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f36ec0f8-5318-4233-a188-5fc9ef6f874d tempest-SnapshotsActionsTest-1121244827 None] Create snapshot completed successfully Jul 21 19:05:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Acquiring lock "cinder-7dd9098e-ee07-44ef-b70a-1a0520d9b9fa-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-7dd9098e-ee07-44ef-b70a-1a0520d9b9fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Acquiring lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Acquiring lock "cinder-quobyte-7dd9098e-ee07-44ef-b70a-1a0520d9b9fa" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-7dd9098e-ee07-44ef-b70a-1a0520d9b9fa" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Deleting offline snapshot 7dd9098e-ee07-44ef-b70a-1a0520d9b9fa of volume 44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:05:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] snapshot_file for this snap is: volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:05:24 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[796591bf-2097-428a-afbe-9d8bbf983a95]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:24 devstack sudo[92639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa Jul 21 19:05:24 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:24 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90 1073741824" returned: 0 in 1.349s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:24 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90 Jul 21 19:05:24 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:25 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90" returned: 0 in 0.399s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:25 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa" returned: 0 in 0.762s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e98c0d-d613-4e91-9bf4-f841cc080bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30969cab-0f27-4b61-afbb-6a5123ac0e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04b8e57c-ff72-4338-8211-6711bcad4d90', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a9f45f-c633-44e0-8574-53a44d303ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbe7d6d-bf77-4175-976c-8e968fb12254]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:25 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Volume volume-04b8e57c-ff72-4338-8211-6711bcad4d90 (04b8e57c-ff72-4338-8211-6711bcad4d90): created successfully Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a9f45f-c633-44e0-8574-53a44d303ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Flow 'volume_create_manager' (ff4dc69e-a711-4ed5-9e21-55055d8b3d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-d614cec6-93e6-4615-ba8f-627f7df1608f req-486f9ca7-7afe-4108-b026-49a3a6d55acd tempest-VolumesSnapshotsTestJSON-331403470 None] Created volume successfully. Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Flow 'volume_create_manager' (4a3576b1-dc45-4308-8d29-50f63962afba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc41c40-13c1-45e7-8188-ce834a9d8f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc41c40-13c1-45e7-8188-ce834a9d8f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1542520688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f802dfd8a18d4d889528b6a157997b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:26Z,use_quota=True,user_id='8134a9dccf46441f862e1735c5510ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde2f89a-8bab-427f-b23c-edc855a7d6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde2f89a-8bab-427f-b23c-edc855a7d6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:25 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f Jul 21 19:05:25 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3516ca-b59e-4798-aa3c-3527d8c3db8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3516ca-b59e-4798-aa3c-3527d8c3db8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd58f1c69-bb0c-4dd5-be54-a8deb6a6d63a', 'volume_name': 'volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12faa538-2e42-4f5c-9796-1b80dcc1cacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12faa538-2e42-4f5c-9796-1b80dcc1cacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0049afa8-7f33-460c-b76a-aedbceab16a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:25 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Volume d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a', 'volume_size': 1} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1542520688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f802dfd8a18d4d889528b6a157997b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:26Z,use_quota=True,user_id='8134a9dccf46441f862e1735c5510ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Creating volume d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:25 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:05:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:25 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a 1073741824 Jul 21 19:05:25 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:25 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f" returned: 0 in 0.675s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e98c0d-d613-4e91-9bf4-f841cc080bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:26 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa Jul 21 19:05:26 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:26 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a 1073741824" returned: 0 in 1.031s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:26 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a Jul 21 19:05:26 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa" returned: 0 in 1.032s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:27 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:27 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa Jul 21 19:05:27 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:27 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a" returned: 0 in 0.442s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.146s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0049afa8-7f33-460c-b76a-aedbceab16a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89e33e5-6ebf-4f95-b69f-6849d765ae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] Creating offline snapshot e06f1503-1170-458b-ac4f-cb662b5c210f of volume 04b8e57c-ff72-4338-8211-6711bcad4d90 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:05:27 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Volume volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a (d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a): created successfully Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89e33e5-6ebf-4f95-b69f-6849d765ae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Flow 'volume_create_manager' (4a3576b1-dc45-4308-8d29-50f63962afba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d37ddf-f42f-4aee-961c-e978a58ebfeb]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:27 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c813b587-616d-4ce0-9429-9273b195fa41 tempest-VolumesActionsTest-1616583792 None] Created volume successfully. Jul 21 19:05:27 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.7dd9098e-ee07-44ef-b70a-1a0520d9b9fa" returned: 0 in 0.630s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:27 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90 Jul 21 19:05:27 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-7dd9098e-ee07-44ef-b70a-1a0520d9b9fa" released by "_delete_snapshot" :: held 3.324s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" released by "delete_snapshot" :: held 3.384s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Created reservations ['3a865623-324a-4c83-865e-101370169835', '2307abbf-6b14-46c7-8f56-957fe8a9b4cc', '7fcbaae2-f2c9-4c58-ab02-36a441af1ee3', '3a966b37-4198-4b0a-b99d-203468f69193'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6d8da641-c8b9-42f8-8dc7-c60d2cafa33d tempest-VolumesActionsTest-1616583792 None] Acquiring lock "cinder-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a" by "attach_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6d8da641-c8b9-42f8-8dc7-c60d2cafa33d tempest-VolumesActionsTest-1616583792 None] Lock "cinder-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a" acquired by "attach_volume" :: waited 0.037s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:28 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Delete snapshot completed successfully. Jul 21 19:05:28 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90" returned: 0 in 0.582s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d1e32166-06b6-49b3-b8ff-229d03f1874d tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-7dd9098e-ee07-44ef-b70a-1a0520d9b9fa-delete_snapshot" released by "delete_snapshot" :: held 3.825s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:28 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-6d8da641-c8b9-42f8-8dc7-c60d2cafa33d tempest-VolumesActionsTest-1616583792 None] Attaching volume d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a to instance c07ce6b5-e576-450f-a8e4-769d0c0e698a at mountpoint /dev/vdb on host None. Jul 21 19:05:28 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f 1G Jul 21 19:05:28 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:28 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-6d8da641-c8b9-42f8-8dc7-c60d2cafa33d tempest-VolumesActionsTest-1616583792 None] Attach volume completed successfully. Jul 21 19:05:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6d8da641-c8b9-42f8-8dc7-c60d2cafa33d tempest-VolumesActionsTest-1616583792 None] Lock "cinder-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a" released by "attach_volume" :: held 0.261s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:29 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f 1G" returned: 0 in 0.960s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04b8e57c-ff72-4338-8211-6711bcad4d90 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:29 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04b8e57c-ff72-4338-8211-6711bcad4d90 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f Jul 21 19:05:29 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:29 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-483a3b9d-7725-4b1f-82a9-e4a6ac576b90 tempest-VolumesActionsTest-283955735 None] Terminate volume connection completed successfully. Jul 21 19:05:29 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-483a3b9d-7725-4b1f-82a9-e4a6ac576b90 tempest-VolumesActionsTest-283955735 None] Acquiring lock "cinder-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a-detach_volume" by "detach_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04b8e57c-ff72-4338-8211-6711bcad4d90 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f" returned: 0 in 0.770s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:29 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f is being set with open permissions: ugo+rw Jul 21 19:05:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-483a3b9d-7725-4b1f-82a9-e4a6ac576b90 tempest-VolumesActionsTest-283955735 None] Lock "cinder-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:29 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f Jul 21 19:05:29 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:29 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-483a3b9d-7725-4b1f-82a9-e4a6ac576b90 tempest-VolumesActionsTest-283955735 None] Detaching volume d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a from instance c07ce6b5-e576-450f-a8e4-769d0c0e698a. Jul 21 19:05:30 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-483a3b9d-7725-4b1f-82a9-e4a6ac576b90 tempest-VolumesActionsTest-283955735 None] Detach volume completed successfully. Jul 21 19:05:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-483a3b9d-7725-4b1f-82a9-e4a6ac576b90 tempest-VolumesActionsTest-283955735 None] Lock "cinder-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a-detach_volume" released by "detach_volume" :: held 0.236s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:30 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f" returned: 0 in 0.512s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:30 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.info Jul 21 19:05:30 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ce65eb48-1e0e-4046-a307-cd96bd99d5f4 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "cinder-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a-detach_volume" by "detach_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ce65eb48-1e0e-4046-a307-cd96bd99d5f4 tempest-VolumesActionsTest-1616583792 None] Lock "cinder-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:30 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ce65eb48-1e0e-4046-a307-cd96bd99d5f4 tempest-VolumesActionsTest-1616583792 None] Volume detach called, but volume not attached. Jul 21 19:05:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ce65eb48-1e0e-4046-a307-cd96bd99d5f4 tempest-VolumesActionsTest-1616583792 None] Lock "cinder-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a-detach_volume" released by "detach_volume" :: held 0.054s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:30 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.info" returned: 0 in 0.452s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:30 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.info is being set with open permissions: ugo+rw Jul 21 19:05:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:30 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.info Jul 21 19:05:30 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "cinder-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Lock "cinder-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "cinder-quobyte-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Lock "cinder-quobyte-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a" acquired by "delete_volume" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efa9ada-461b-4259-90c0-f872cbc07598]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:31 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a Jul 21 19:05:31 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:31 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.info" returned: 0 in 0.482s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.017s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.707s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] Creating offline snapshot 25b10e58-d897-4553-b8c6-3cc659ee0f9c of volume 44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfc68c9-621a-43d6-b20a-6e6e7baed3cb]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:31 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-98702e4f-b1e5-4562-b41e-b134f8a91e33 req-ea098e27-97b5-437b-a3cc-66be37d526fd tempest-VolumesSnapshotsTestJSON-331403470 None] Create snapshot completed successfully Jul 21 19:05:31 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a" returned: 0 in 0.551s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:31 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a Jul 21 19:05:31 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:31 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f Jul 21 19:05:31 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:31 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a" returned: 0 in 0.278s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Lock "cinder-quobyte-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a" released by "delete_volume" :: held 0.880s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:31 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Created reservations ['24dc71ca-4a4e-4760-93f7-c917d53830ab', 'a875c3b0-6529-4c4a-80cf-7f16df1b33f4', 'd4c8a629-5330-4bcd-902c-671f7f75efdf', '5881e671-d23d-47fc-ba38-6b55362d6e3c'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:32 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f" returned: 0 in 0.517s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e98c0d-d613-4e91-9bf4-f841cc080bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:32 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c 1G Jul 21 19:05:32 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:32 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:05:32 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Acquiring lock "cinder-e06f1503-1170-458b-ac4f-cb662b5c210f-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "cinder-e06f1503-1170-458b-ac4f-cb662b5c210f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Acquiring lock "cinder-quobyte-04b8e57c-ff72-4338-8211-6711bcad4d90" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "cinder-quobyte-04b8e57c-ff72-4338-8211-6711bcad4d90" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Acquiring lock "cinder-quobyte-e06f1503-1170-458b-ac4f-cb662b5c210f" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:32 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.481s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:32 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Deleted volume successfully. Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "cinder-quobyte-e06f1503-1170-458b-ac4f-cb662b5c210f" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Deleting offline snapshot e06f1503-1170-458b-ac4f-cb662b5c210f of volume 04b8e57c-ff72-4338-8211-6711bcad4d90 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] snapshot_file for this snap is: volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b1198456-c3a5-4d7d-a581-c792fd4ac1b2 tempest-VolumesActionsTest-1616583792 None] Lock "cinder-d58f1c69-bb0c-4dd5-be54-a8deb6a6d63a-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c58b4e2-6372-40d3-94de-c3eef55f8718]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:32 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c 1G" returned: 0 in 0.781s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:32 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c Jul 21 19:05:32 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:33 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f Jul 21 19:05:33 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:33 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c" returned: 0 in 0.826s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:33 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c is being set with open permissions: ugo+rw Jul 21 19:05:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:33 devstack sudo[92804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c Jul 21 19:05:33 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:33 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f" returned: 0 in 0.974s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04b8e57c-ff72-4338-8211-6711bcad4d90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:33 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2556e74-4e87-4d07-b9c5-8caa38da2c9d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:34 devstack sudo[92809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90 Jul 21 19:05:34 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:34 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c" returned: 0 in 0.402s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.712s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:34 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5324d635-d28b-4ab2-b9da-a7b4b33ceb4b tempest-SnapshotsActionsTest-1121244827 None] Create snapshot completed successfully Jul 21 19:05:34 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90" returned: 0 in 0.612s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:34 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f Jul 21 19:05:34 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:35 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f" returned: 0 in 0.782s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Acquiring lock "cinder-62821ac7-3e7a-44c0-968d-0dfa04ad182e-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:35 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f Jul 21 19:05:35 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Lock "cinder-62821ac7-3e7a-44c0-968d-0dfa04ad182e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Acquiring lock "cinder-25b10e58-d897-4553-b8c6-3cc659ee0f9c-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-25b10e58-d897-4553-b8c6-3cc659ee0f9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Acquiring lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Acquiring lock "cinder-quobyte-62821ac7-3e7a-44c0-968d-0dfa04ad182e" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Acquiring lock "cinder-quobyte-25b10e58-d897-4553-b8c6-3cc659ee0f9c" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-25b10e58-d897-4553-b8c6-3cc659ee0f9c" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Deleting offline snapshot 25b10e58-d897-4553-b8c6-3cc659ee0f9c of volume 44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] snapshot_file for this snap is: volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Lock "cinder-quobyte-62821ac7-3e7a-44c0-968d-0dfa04ad182e" acquired by "delete_volume" :: waited 0.088s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4f0797-1ee0-4d23-b2b9-51d3475df4fa]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8a89bf-a07a-426e-b4c3-6428f3002d0b]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:35 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c Jul 21 19:05:35 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:35 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90.e06f1503-1170-458b-ac4f-cb662b5c210f" returned: 0 in 0.520s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:35 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e Jul 21 19:05:35 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "cinder-quobyte-e06f1503-1170-458b-ac4f-cb662b5c210f" released by "_delete_snapshot" :: held 3.214s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "cinder-quobyte-04b8e57c-ff72-4338-8211-6711bcad4d90" released by "delete_snapshot" :: held 3.306s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:36 devstack cinder-volume[87487]: DEBUG cinder.quota [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Created reservations ['76dffe8f-dfe9-4d7d-bad2-09093a712189', '87c516d6-afa7-4b1b-9a95-eda5dc9cf221', 'ce27abb0-f75c-4cf8-a802-6da06ef7a8d1', 'ab9a0d85-e37b-4443-b068-bbdd05c2b93d'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:36 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Delete snapshot completed successfully. Jul 21 19:05:36 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-327bd490-3379-4f92-b44d-b33498940e34 req-7dad9e5b-70ff-4b9f-a5e6-43e6002a293e tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "cinder-e06f1503-1170-458b-ac4f-cb662b5c210f-delete_snapshot" released by "delete_snapshot" :: held 3.736s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:36 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c" returned: 0 in 0.808s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e98c0d-d613-4e91-9bf4-f841cc080bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:36 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2407a49-dd00-454a-ad70-c4a29dee2e4e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:36 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e" returned: 0 in 0.957s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:36 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e Jul 21 19:05:36 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:36 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f Jul 21 19:05:36 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:36 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-62821ac7-3e7a-44c0-968d-0dfa04ad182e" returned: 0 in 0.315s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:36 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Lock "cinder-quobyte-62821ac7-3e7a-44c0-968d-0dfa04ad182e" released by "delete_volume" :: held 1.342s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:36 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f" returned: 0 in 0.499s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e98c0d-d613-4e91-9bf4-f841cc080bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:36 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c Jul 21 19:05:36 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:36 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Created reservations ['e8bb0105-b260-4e1f-9f76-a45e43e8a1be', '75d21a27-7818-4123-b65f-b074837e5af9', 'd011e817-e303-4f43-ac44-5ef404b3f60b', 'a8e32a17-6ffe-437e-b617-871f7f3906dd'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:37 devstack sudo[92850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:05:37 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Acquiring lock "cinder-04b8e57c-ff72-4338-8211-6711bcad4d90-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:37 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.381s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:37 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Deleted volume successfully. Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "cinder-04b8e57c-ff72-4338-8211-6711bcad4d90-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a5eb5c85-d77d-42e7-8d17-c34f03bbee5c tempest-ServerRescueNegativeTestJSON-1740397736 None] Lock "cinder-62821ac7-3e7a-44c0-968d-0dfa04ad182e-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Acquiring lock "cinder-quobyte-04b8e57c-ff72-4338-8211-6711bcad4d90" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:37 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c" returned: 0 in 0.728s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "cinder-quobyte-04b8e57c-ff72-4338-8211-6711bcad4d90" acquired by "delete_volume" :: waited 0.072s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:37 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c Jul 21 19:05:37 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[777d37ea-c03d-4ad1-bbc9-7ccb308aff63]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:37 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90 Jul 21 19:05:37 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:38 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.25b10e58-d897-4553-b8c6-3cc659ee0f9c" returned: 0 in 0.586s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-25b10e58-d897-4553-b8c6-3cc659ee0f9c" released by "_delete_snapshot" :: held 2.798s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" released by "delete_snapshot" :: held 2.855s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Flow 'volume_create_manager' (69975be8-5bb0-4157-b3db-6fcec1e6b201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa160777-6c71-483b-bce8-d2906a1c6237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa160777-6c71-483b-bce8-d2906a1c6237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-943367564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d5b75c-187f-4642-809d-bca06803f8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f802dfd8a18d4d889528b6a157997b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:38Z,use_quota=True,user_id='8134a9dccf46441f862e1735c5510ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39099168-40ce-4722-8918-ff38e87204a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39099168-40ce-4722-8918-ff38e87204a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b774c3a-1ce2-4612-a343-e0a5444545da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b774c3a-1ce2-4612-a343-e0a5444545da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d5b75c-187f-4642-809d-bca06803f8ee', 'volume_name': 'volume-f1d5b75c-187f-4642-809d-bca06803f8ee', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:38 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf727c7-9d8d-4c74-b690-4130e5bd89a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf727c7-9d8d-4c74-b690-4130e5bd89a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6a49c8-c355-4186-a47f-5d06a9603953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:38 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Volume f1d5b75c-187f-4642-809d-bca06803f8ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d5b75c-187f-4642-809d-bca06803f8ee', 'volume_size': 1} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-943367564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d5b75c-187f-4642-809d-bca06803f8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f802dfd8a18d4d889528b6a157997b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:38Z,use_quota=True,user_id='8134a9dccf46441f862e1735c5510ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Creating volume f1d5b75c-187f-4642-809d-bca06803f8ee {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:38 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f1d5b75c-187f-4642-809d-bca06803f8ee 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Created reservations ['b9749ac4-5d62-4503-a397-ce8f11f2cfd0', '6ef20614-0dd9-4c4c-833e-2247ddbd7ffa', 'f718bbae-68f2-48ce-9774-1cdc6e261e3d', 'f9ca16c5-361a-4fa2-b797-45b284451bfe'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90" returned: 0 in 0.936s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:38 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f1d5b75c-187f-4642-809d-bca06803f8ee 1073741824 Jul 21 19:05:38 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:38 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90 Jul 21 19:05:38 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:39 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Delete snapshot completed successfully. Jul 21 19:05:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-724fefb1-752d-44fd-a0d7-88fe032eed26 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-25b10e58-d897-4553-b8c6-3cc659ee0f9c-delete_snapshot" released by "delete_snapshot" :: held 3.600s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:39 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-04b8e57c-ff72-4338-8211-6711bcad4d90" returned: 0 in 0.769s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "cinder-quobyte-04b8e57c-ff72-4338-8211-6711bcad4d90" released by "delete_volume" :: held 1.834s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:39 devstack cinder-volume[87487]: DEBUG cinder.quota [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Created reservations ['86b286dd-87e6-4b12-a1fa-2f48cbe4b35b', '6a4d41bd-82dd-43ba-8350-ea536d62cb2a', 'd731d642-b2c2-4722-9c8d-1086f8477397', '457778da-1c0a-43d6-857d-d4133a4d755c'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:39 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f1d5b75c-187f-4642-809d-bca06803f8ee 1073741824" returned: 0 in 1.110s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:39 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:05:39 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f1d5b75c-187f-4642-809d-bca06803f8ee {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:39 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f1d5b75c-187f-4642-809d-bca06803f8ee Jul 21 19:05:39 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:40 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.753s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG cinder.manager [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:40 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Deleted volume successfully. Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-3455330d-f7c1-46d2-b6ff-c4d453cfd8a0 req-ce31b35c-80d8-4b01-8e26-3e769ba1a115 tempest-VolumesSnapshotsTestJSON-331403470 None] Lock "cinder-04b8e57c-ff72-4338-8211-6711bcad4d90-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:40 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f1d5b75c-187f-4642-809d-bca06803f8ee" returned: 0 in 0.746s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:40 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:05:40 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6a49c8-c355-4186-a47f-5d06a9603953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d5b75c-187f-4642-809d-bca06803f8ee', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c58ded6-62c3-4468-a90f-77a564d41164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:40 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Volume volume-f1d5b75c-187f-4642-809d-bca06803f8ee (f1d5b75c-187f-4642-809d-bca06803f8ee): created successfully Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c58ded6-62c3-4468-a90f-77a564d41164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Flow 'volume_create_manager' (69975be8-5bb0-4157-b3db-6fcec1e6b201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:40 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-7abb2432-a73d-43a5-9d4c-4dafc2c5987e tempest-VolumesActionsTest-1616583792 None] Created volume successfully. Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] Creating offline snapshot 31d56a82-359d-444a-96c9-62a629c5ccd9 of volume 44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:05:41 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebdb7ba-e39b-499a-a679-cc3c78ce95c4]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:41 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.414s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:41 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:41 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:05:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 8 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:05:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:05:41 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f Jul 21 19:05:41 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:41 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f" returned: 0 in 0.615s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e98c0d-d613-4e91-9bf4-f841cc080bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:41 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 1G Jul 21 19:05:41 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Acquiring lock "cinder-f1d5b75c-187f-4642-809d-bca06803f8ee-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Lock "cinder-f1d5b75c-187f-4642-809d-bca06803f8ee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Acquiring lock "cinder-quobyte-f1d5b75c-187f-4642-809d-bca06803f8ee" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Lock "cinder-quobyte-f1d5b75c-187f-4642-809d-bca06803f8ee" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:42 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fc46d5-9d5b-4205-858d-0709781de042]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f1d5b75c-187f-4642-809d-bca06803f8ee {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:42 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 1G" returned: 0 in 0.675s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:42 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 Jul 21 19:05:42 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:42 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f1d5b75c-187f-4642-809d-bca06803f8ee Jul 21 19:05:42 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:42 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f1d5b75c-187f-4642-809d-bca06803f8ee" returned: 0 in 0.518s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f1d5b75c-187f-4642-809d-bca06803f8ee {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:42 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f1d5b75c-187f-4642-809d-bca06803f8ee Jul 21 19:05:42 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:42 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9" returned: 0 in 0.439s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:42 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 is being set with open permissions: ugo+rw Jul 21 19:05:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:42 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 Jul 21 19:05:42 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:43 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f1d5b75c-187f-4642-809d-bca06803f8ee" returned: 0 in 0.421s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Lock "cinder-quobyte-f1d5b75c-187f-4642-809d-bca06803f8ee" released by "delete_volume" :: held 1.003s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:43 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9" returned: 0 in 0.481s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:43 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Created reservations ['6ba9b617-b53e-4e0c-bbc9-3162b72089ec', 'e38ae43f-d989-4d40-94a8-0a8dcffb0f96', 'bb8c8e1b-bb5b-4a7a-9a9b-7d7673aadf9e', 'ef9cfed0-c703-4f1f-8de6-388afbb7cd8f'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:43 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b5d74fa4-9be9-4260-aa42-10cf612fd29c tempest-SnapshotsActionsTest-1121244827 None] Create snapshot completed successfully Jul 21 19:05:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:43 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:05:43 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:43 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.299s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:43 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:43 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Deleted volume successfully. Jul 21 19:05:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e3c94c68-a1ce-4d1c-b576-bfef8f68320f tempest-VolumesActionsTest-283955735 None] Lock "cinder-f1d5b75c-187f-4642-809d-bca06803f8ee-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Acquiring lock "cinder-31d56a82-359d-444a-96c9-62a629c5ccd9-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-31d56a82-359d-444a-96c9-62a629c5ccd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Acquiring lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Acquiring lock "cinder-quobyte-31d56a82-359d-444a-96c9-62a629c5ccd9" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-31d56a82-359d-444a-96c9-62a629c5ccd9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Deleting offline snapshot 31d56a82-359d-444a-96c9-62a629c5ccd9 of volume 44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:05:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] snapshot_file for this snap is: volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:05:44 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[300e2b70-cde6-4ccb-bf6a-b4a9b0f2ef6e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:44 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 Jul 21 19:05:44 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:44 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9" returned: 0 in 0.625s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e98c0d-d613-4e91-9bf4-f841cc080bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9746ffac-5e42-4bf3-85f0-1672ac452f57]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Flow 'volume_create_manager' (bc34336f-8e95-427f-b956-d23374997b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489c77f9-eb0b-4573-a011-9b67028fa3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489c77f9-eb0b-4573-a011-9b67028fa3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1839257733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc90fcfa-8c86-48bd-803a-edb89d0d0ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f802dfd8a18d4d889528b6a157997b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:45Z,use_quota=True,user_id='8134a9dccf46441f862e1735c5510ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50d1aba-2908-499b-bae7-4d4e6eaff41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50d1aba-2908-499b-bae7-4d4e6eaff41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d660c232-6dfd-48c6-865a-c5f163f75e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d660c232-6dfd-48c6-865a-c5f163f75e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc90fcfa-8c86-48bd-803a-edb89d0d0ebe', 'volume_name': 'volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:45 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f Jul 21 19:05:45 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f914bb7-7c45-45e6-944e-c2a0860a8d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f914bb7-7c45-45e6-944e-c2a0860a8d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cd8067-8f27-4f33-a9d3-ec78443158f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:45 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Volume bc90fcfa-8c86-48bd-803a-edb89d0d0ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe', 'volume_size': 1} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1839257733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc90fcfa-8c86-48bd-803a-edb89d0d0ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f802dfd8a18d4d889528b6a157997b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:45Z,use_quota=True,user_id='8134a9dccf46441f862e1735c5510ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Creating volume bc90fcfa-8c86-48bd-803a-edb89d0d0ebe {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:45 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:45 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe 1073741824 Jul 21 19:05:45 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:45 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f" returned: 0 in 0.648s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e98c0d-d613-4e91-9bf4-f841cc080bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:45 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 Jul 21 19:05:45 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:46 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe 1073741824" returned: 0 in 0.578s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:46 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe Jul 21 19:05:46 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:46 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9" returned: 0 in 0.522s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:46 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9 Jul 21 19:05:46 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:46 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe" returned: 0 in 0.293s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cd8067-8f27-4f33-a9d3-ec78443158f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1a47b9-806d-410f-a924-b878d67f8cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:46 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Volume volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe (bc90fcfa-8c86-48bd-803a-edb89d0d0ebe): created successfully Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1a47b9-806d-410f-a924-b878d67f8cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Flow 'volume_create_manager' (bc34336f-8e95-427f-b956-d23374997b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:46 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a59b3121-ed6e-45b4-9454-82cec92aece0 tempest-VolumesActionsTest-1616583792 None] Created volume successfully. Jul 21 19:05:46 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.31d56a82-359d-444a-96c9-62a629c5ccd9" returned: 0 in 0.316s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-31d56a82-359d-444a-96c9-62a629c5ccd9" released by "_delete_snapshot" :: held 2.293s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" released by "delete_snapshot" :: held 2.322s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Created reservations ['690f6bd7-b691-46b5-a2c4-eb01763ff930', '3d198386-48fb-4ddc-990c-5fd9d342c529', '9012649c-9bcc-4cb2-9fff-f26ea45f4682', '69e143b9-900b-41da-9407-b7f312703c55'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:46 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Delete snapshot completed successfully. Jul 21 19:05:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18df8cf5-9e6c-4338-a3e6-e03de7e263d0 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-31d56a82-359d-444a-96c9-62a629c5ccd9-delete_snapshot" released by "delete_snapshot" :: held 2.491s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:46 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b1ae4888-6719-4041-9b1a-50beee01bb74 tempest-GroupSnapshotsV319Test-1941491820 None] Group tempest-GroupSnapshotsV319Test-Group-271826423: creating Jul 21 19:05:47 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b1ae4888-6719-4041-9b1a-50beee01bb74 tempest-GroupSnapshotsV319Test-1941491820 None] Group tempest-GroupSnapshotsV319Test-Group-271826423: created successfully Jul 21 19:05:47 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b1ae4888-6719-4041-9b1a-50beee01bb74 tempest-GroupSnapshotsV319Test-1941491820 None] Create group completed successfully. Jul 21 19:05:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Acquiring lock "cinder-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Lock "cinder-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Acquiring lock "cinder-quobyte-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Lock "cinder-quobyte-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:47 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a71a452-b7b2-4af4-ba70-fbf1f6827d2e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:47 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe Jul 21 19:05:47 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] Creating offline snapshot 61f30dce-115e-48ab-bb20-eac650933ebb of volume 44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:05:47 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d20e4a-bb0c-4606-8114-513affeb89eb]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:48 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f Jul 21 19:05:48 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:48 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe" returned: 0 in 0.467s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:48 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe Jul 21 19:05:48 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:48 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe" returned: 0 in 0.305s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:48 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f" returned: 0 in 0.473s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e98c0d-d613-4e91-9bf4-f841cc080bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Lock "cinder-quobyte-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe" released by "delete_volume" :: held 0.833s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:48 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb 1G Jul 21 19:05:48 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Created reservations ['02256aa4-7e17-4e7c-9608-1a1b5eec9c9e', 'fcc80216-d652-42a6-b7c9-849c1a0f04de', 'ae44cf1b-0e47-4206-9e36-494adfaaf74a', 'dcb094d8-16e3-46f7-ae01-6651642b945e'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:48 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:05:48 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:48 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.384s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:48 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Deleted volume successfully. Jul 21 19:05:48 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Flow 'volume_create_manager' (b437b67b-c9b3-4bf5-9357-d3a320bef5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2ef3ae-b57e-4ec7-9744-52b9f5f73604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb 1G" returned: 0 in 0.681s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:49 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2ef3ae-b57e-4ec7-9744-52b9f5f73604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1735400935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bc5c5a78-67ca-4e91-9901-bbff81369e3b,host='devstack@QuobyteHD#QuobyteHD',id=b76f002a-c33c-4148-a1dd-a1bd4a29c34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82df31d5f19245f58cf874bf8f9dab0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:49Z,use_quota=True,user_id='f30ba37f67c742dda5f7c9f0d6707c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(274f0b77-23f5-4f78-899f-0fac40bb759f),volume_type_id=274f0b77-23f5-4f78-899f-0fac40bb759f)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18bcfcc1-8287-4597-a4dc-af00ddad2293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18bcfcc1-8287-4597-a4dc-af00ddad2293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bba806-eb88-4e78-b1de-2ec808336c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:49 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bba806-eb88-4e78-b1de-2ec808336c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b76f002a-c33c-4148-a1dd-a1bd4a29c34a', 'volume_name': 'volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:49 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f6ed96-dff7-40dc-a43b-d0a9b272caf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f6ed96-dff7-40dc-a43b-d0a9b272caf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5604f7-d50f-44b0-b9cf-ae38fb3385a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:49 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Volume b76f002a-c33c-4148-a1dd-a1bd4a29c34a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a', 'volume_size': 1} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bd85c056-d3e3-4002-9660-ff13dacef7d0 tempest-VolumesActionsTest-283955735 None] Lock "cinder-bc90fcfa-8c86-48bd-803a-edb89d0d0ebe-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:49 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb" returned: 0 in 0.359s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:49 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb is being set with open permissions: ugo+rw Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:49 devstack sudo[93034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb Jul 21 19:05:49 devstack sudo[93034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Flow 'volume_create_manager' (261e6524-616f-46f4-9ba4-10cd3b15537d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b72b8e-202a-470c-bdfe-969b4be4e1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b72b8e-202a-470c-bdfe-969b4be4e1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1841288247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba0356e-fc3e-4423-9397-bb2bf5703840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f802dfd8a18d4d889528b6a157997b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:49Z,use_quota=True,user_id='8134a9dccf46441f862e1735c5510ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710589c7-def4-4121-82e5-3f2206ab9d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710589c7-def4-4121-82e5-3f2206ab9d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f469201-2bd9-42dd-9f7c-b92cde8716ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f469201-2bd9-42dd-9f7c-b92cde8716ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ba0356e-fc3e-4423-9397-bb2bf5703840', 'volume_name': 'volume-8ba0356e-fc3e-4423-9397-bb2bf5703840', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6490485b-9856-401b-a64a-6806018757f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6490485b-9856-401b-a64a-6806018757f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ba1619-dbcd-40fc-af87-e2d3ddd931fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:49 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Volume 8ba0356e-fc3e-4423-9397-bb2bf5703840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ba0356e-fc3e-4423-9397-bb2bf5703840', 'volume_size': 1} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:49 devstack sudo[93034]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb" returned: 0 in 0.290s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.619s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bc5c5a78-67ca-4e91-9901-bbff81369e3b,created_at=2026-07-21T17:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1735400935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bc5c5a78-67ca-4e91-9901-bbff81369e3b,host='devstack@QuobyteHD#QuobyteHD',id=b76f002a-c33c-4148-a1dd-a1bd4a29c34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82df31d5f19245f58cf874bf8f9dab0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:49Z,use_quota=True,user_id='f30ba37f67c742dda5f7c9f0d6707c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(274f0b77-23f5-4f78-899f-0fac40bb759f),volume_type_id=274f0b77-23f5-4f78-899f-0fac40bb759f)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Creating volume b76f002a-c33c-4148-a1dd-a1bd4a29c34a {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:49 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:05:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:49 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a 1073741824 Jul 21 19:05:49 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:49 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d20b3856-fa22-4908-bc8a-542fc83ba88d tempest-SnapshotsActionsTest-1121244827 None] Create snapshot completed successfully Jul 21 19:05:50 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a 1073741824" returned: 0 in 0.525s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Acquiring lock "cinder-61f30dce-115e-48ab-bb20-eac650933ebb-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:50 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a Jul 21 19:05:50 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-61f30dce-115e-48ab-bb20-eac650933ebb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Acquiring lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Acquiring lock "cinder-quobyte-61f30dce-115e-48ab-bb20-eac650933ebb" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-61f30dce-115e-48ab-bb20-eac650933ebb" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Deleting offline snapshot 61f30dce-115e-48ab-bb20-eac650933ebb of volume 44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] snapshot_file for this snap is: volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[31024c58-fbc8-4dc9-88af-fb56ee39945a]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:50 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb Jul 21 19:05:50 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:50 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a" returned: 0 in 0.342s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.071s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1841288247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba0356e-fc3e-4423-9397-bb2bf5703840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f802dfd8a18d4d889528b6a157997b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:49Z,use_quota=True,user_id='8134a9dccf46441f862e1735c5510ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Creating volume 8ba0356e-fc3e-4423-9397-bb2bf5703840 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:50 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8ba0356e-fc3e-4423-9397-bb2bf5703840 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:50 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8ba0356e-fc3e-4423-9397-bb2bf5703840 1073741824 Jul 21 19:05:50 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5604f7-d50f-44b0-b9cf-ae38fb3385a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6719c32d-474f-43c4-a280-a3b822375204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:50 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Volume volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a (b76f002a-c33c-4148-a1dd-a1bd4a29c34a): created successfully Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6719c32d-474f-43c4-a280-a3b822375204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Flow 'volume_create_manager' (b437b67b-c9b3-4bf5-9357-d3a320bef5d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:50 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f6c28160-f090-48e2-8918-942e2770a296 tempest-GroupSnapshotsV319Test-1941491820 None] Created volume successfully. Jul 21 19:05:50 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb" returned: 0 in 0.422s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e98c0d-d613-4e91-9bf4-f841cc080bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab951266-870d-4d1b-b493-558254830626]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:51 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f Jul 21 19:05:51 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:51 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8ba0356e-fc3e-4423-9397-bb2bf5703840 1073741824" returned: 0 in 0.566s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8ba0356e-fc3e-4423-9397-bb2bf5703840 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:51 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8ba0356e-fc3e-4423-9397-bb2bf5703840 Jul 21 19:05:51 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:51 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f" returned: 0 in 0.528s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e98c0d-d613-4e91-9bf4-f841cc080bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:51 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb Jul 21 19:05:51 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:51 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8ba0356e-fc3e-4423-9397-bb2bf5703840" returned: 0 in 0.340s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ba1619-dbcd-40fc-af87-e2d3ddd931fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba0356e-fc3e-4423-9397-bb2bf5703840', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4270ab48-982d-4d2b-b393-fb48757c5194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:51 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] GroupSnapshot 50636681-1c36-4e0b-9157-5d602a361e37: creating. Jul 21 19:05:51 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Volume volume-8ba0356e-fc3e-4423-9397-bb2bf5703840 (8ba0356e-fc3e-4423-9397-bb2bf5703840): created successfully Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4270ab48-982d-4d2b-b393-fb48757c5194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Flow 'volume_create_manager' (261e6524-616f-46f4-9ba4-10cd3b15537d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] Group snapshot 50636681-1c36-4e0b-9157-5d602a361e37: creating. {{(pid=87487) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 19:05:51 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5698000e-e462-4dcf-8ed4-0c33f6f7ff20 tempest-VolumesActionsTest-1616583792 None] Created volume successfully. Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] Creating offline snapshot 79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 of volume b76f002a-c33c-4148-a1dd-a1bd4a29c34a {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[781fc100-d144-4230-b6a2-62adaf47c24c]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:51 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a Jul 21 19:05:51 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:51 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb" returned: 0 in 0.476s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:52 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb Jul 21 19:05:52 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:52 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a" returned: 0 in 0.423s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:52 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 1G Jul 21 19:05:52 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:52 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.61f30dce-115e-48ab-bb20-eac650933ebb" returned: 0 in 0.299s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-61f30dce-115e-48ab-bb20-eac650933ebb" released by "_delete_snapshot" :: held 1.863s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" released by "delete_snapshot" :: held 1.900s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:52 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Created reservations ['747ef591-9a82-4f39-8b24-138e89861e30', 'abc94242-edc0-4e30-a455-9d09e645ae7d', '96caaaac-5cf0-43cb-b8e8-7c20e26c924b', '303c1065-16a2-45fc-be9d-5549453d20f5'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:52 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Delete snapshot completed successfully. Jul 21 19:05:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-68db4cf5-b2c6-4dc1-8bdc-ef18f13bfbd7 tempest-SnapshotsActionsTest-1221385359 None] Lock "cinder-61f30dce-115e-48ab-bb20-eac650933ebb-delete_snapshot" released by "delete_snapshot" :: held 2.065s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:52 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 1G" returned: 0 in 0.536s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:52 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 Jul 21 19:05:52 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Acquiring lock "cinder-8ba0356e-fc3e-4423-9397-bb2bf5703840-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Lock "cinder-8ba0356e-fc3e-4423-9397-bb2bf5703840-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Acquiring lock "cinder-3033cf22-d6f9-4d36-8a95-49bd82b5656f-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Lock "cinder-3033cf22-d6f9-4d36-8a95-49bd82b5656f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Acquiring lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Acquiring lock "cinder-quobyte-8ba0356e-fc3e-4423-9397-bb2bf5703840" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Acquiring lock "cinder-quobyte-3033cf22-d6f9-4d36-8a95-49bd82b5656f" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Lock "cinder-quobyte-8ba0356e-fc3e-4423-9397-bb2bf5703840" acquired by "delete_volume" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Lock "cinder-quobyte-3033cf22-d6f9-4d36-8a95-49bd82b5656f" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Deleting offline snapshot 3033cf22-d6f9-4d36-8a95-49bd82b5656f of volume 44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] snapshot_file for this snap is: volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa4bffe-f57b-42ba-be97-9bb7ca816e10]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8ba0356e-fc3e-4423-9397-bb2bf5703840 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[183ccbe6-718f-4cb6-90f8-32ed402323b4]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:53 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8" returned: 0 in 0.439s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:53 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:53 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 Jul 21 19:05:53 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:53 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8ba0356e-fc3e-4423-9397-bb2bf5703840 Jul 21 19:05:53 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:53 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f Jul 21 19:05:53 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:53 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8" returned: 0 in 0.393s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:53 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:53 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f" returned: 0 in 0.459s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8ba0356e-fc3e-4423-9397-bb2bf5703840" returned: 0 in 0.479s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e98c0d-d613-4e91-9bf4-f841cc080bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:53 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.info Jul 21 19:05:53 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8ba0356e-fc3e-4423-9397-bb2bf5703840 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:53 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8ba0356e-fc3e-4423-9397-bb2bf5703840 Jul 21 19:05:53 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee91104e-9f66-40ce-95f0-74814be5a577]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:53 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad Jul 21 19:05:53 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:53 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.info" returned: 0 in 0.325s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:53 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:05:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:54 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.info Jul 21 19:05:54 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:54 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8ba0356e-fc3e-4423-9397-bb2bf5703840" returned: 0 in 0.366s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Lock "cinder-quobyte-8ba0356e-fc3e-4423-9397-bb2bf5703840" released by "delete_volume" :: held 0.950s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Created reservations ['4686d986-344f-4ef6-a31c-7393893135e9', '0d8765dc-8443-4202-8c2f-d6b4eb62bde9', 'ff60d5b4-d026-4ed8-a4eb-f01861c952ad', 'f54dfe28-d0f7-44eb-9e48-9347e11d760b'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:54 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad" returned: 0 in 0.525s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:54 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:05:54 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:54 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f Jul 21 19:05:54 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:54 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.info" returned: 0 in 0.448s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.672s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:54 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-8a8902fd-68f4-424c-95e7-51f51859e789 tempest-GroupSnapshotsV319Test-1941491820 None] group_snapshot 50636681-1c36-4e0b-9157-5d602a361e37: created successfully Jul 21 19:05:54 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.343s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:54 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Deleted volume successfully. Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c9a828a4-0246-4e90-ab6b-3aba120b7b3b tempest-VolumesActionsTest-283955735 None] Lock "cinder-8ba0356e-fc3e-4423-9397-bb2bf5703840-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:54 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f" returned: 0 in 0.432s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:54 devstack sudo[93129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f Jul 21 19:05:54 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:55 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad.3033cf22-d6f9-4d36-8a95-49bd82b5656f" returned: 0 in 0.321s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Lock "cinder-quobyte-3033cf22-d6f9-4d36-8a95-49bd82b5656f" released by "_delete_snapshot" :: held 1.923s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" released by "delete_snapshot" :: held 1.977s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Created reservations ['61acaab9-efe7-43e2-8661-39ae92399ebf', '90c50edf-fbda-428e-b425-2952b8cfc3a3', 'c96b18be-8a3c-4b64-ad7a-29715c920b42', '349a5c8c-ffcc-45b2-845c-f6474fcc5e1e'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:55 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Delete snapshot completed successfully. Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-08f06eb8-6ef8-44e8-b60d-536010ce78b2 tempest-SnapshotsActionsTest-1121244827 None] Lock "cinder-3033cf22-d6f9-4d36-8a95-49bd82b5656f-delete_snapshot" released by "delete_snapshot" :: held 2.235s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:55 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] group_snapshot 50636681-1c36-4e0b-9157-5d602a361e37: deleting Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] group_snapshot 50636681-1c36-4e0b-9157-5d602a361e37: deleting {{(pid=87487) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Acquiring lock "cinder-quobyte-b76f002a-c33c-4148-a1dd-a1bd4a29c34a" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Lock "cinder-quobyte-b76f002a-c33c-4148-a1dd-a1bd4a29c34a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Acquiring lock "cinder-quobyte-79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Lock "cinder-quobyte-79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Deleting offline snapshot 79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 of volume b76f002a-c33c-4148-a1dd-a1bd4a29c34a {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] snapshot_file for this snap is: volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a3ad79-d2f8-4bbc-8486-92c3a8d1da39]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:55 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 Jul 21 19:05:55 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Flow 'volume_create_manager' (87a56266-73d8-44ac-a367-5e2322be5751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26eb20a3-e52f-48de-b862-d909475cb0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26eb20a3-e52f-48de-b862-d909475cb0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-64425966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa817fc9-0ea2-4861-afa2-1d0f0551a960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f802dfd8a18d4d889528b6a157997b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:56Z,use_quota=True,user_id='8134a9dccf46441f862e1735c5510ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0f5a7e-d270-4bbc-8693-d392f9b5231c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0f5a7e-d270-4bbc-8693-d392f9b5231c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe82e74c-a761-441b-8e34-5f7f6ef1fa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe82e74c-a761-441b-8e34-5f7f6ef1fa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa817fc9-0ea2-4861-afa2-1d0f0551a960', 'volume_name': 'volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bce00dd-b9e6-435c-9f15-a04c757bd3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bce00dd-b9e6-435c-9f15-a04c757bd3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd007d0-6b66-4f1e-947e-8e72080e0cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:55 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Volume aa817fc9-0ea2-4861-afa2-1d0f0551a960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960', 'volume_size': 1} Jul 21 19:05:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-64425966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa817fc9-0ea2-4861-afa2-1d0f0551a960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f802dfd8a18d4d889528b6a157997b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:56Z,use_quota=True,user_id='8134a9dccf46441f862e1735c5510ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Creating volume aa817fc9-0ea2-4861-afa2-1d0f0551a960 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:56 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:56 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960 1073741824 Jul 21 19:05:56 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:56 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8" returned: 0 in 0.528s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e23dbe-1700-43d0-956d-465200ddee3e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:56 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a Jul 21 19:05:56 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Acquiring lock "cinder-44e98c0d-d613-4e91-9bf4-f841cc080bad-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Lock "cinder-44e98c0d-d613-4e91-9bf4-f841cc080bad-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Acquiring lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" acquired by "delete_volume" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[228e8961-7b92-4e15-8c5c-fe7e3bc6f77f]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:56 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960 1073741824" returned: 0 in 0.612s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:56 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a" returned: 0 in 0.532s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:56 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad Jul 21 19:05:56 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:56 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 Jul 21 19:05:56 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:56 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960 Jul 21 19:05:56 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:56 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960" returned: 0 in 0.320s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd007d0-6b66-4f1e-947e-8e72080e0cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd40b2e-2166-4c4f-b64c-d02558c4b73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:57 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad" returned: 0 in 0.489s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:57 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Volume volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960 (aa817fc9-0ea2-4861-afa2-1d0f0551a960): created successfully Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd40b2e-2166-4c4f-b64c-d02558c4b73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Flow 'volume_create_manager' (87a56266-73d8-44ac-a367-5e2322be5751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:57 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad Jul 21 19:05:57 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:57 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c086d390-e74e-4ab6-a1d4-617ab4283326 tempest-VolumesActionsTest-1616583792 None] Created volume successfully. Jul 21 19:05:57 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8" returned: 0 in 0.482s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:57 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8 Jul 21 19:05:57 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:57 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44e98c0d-d613-4e91-9bf4-f841cc080bad" returned: 0 in 0.311s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Lock "cinder-quobyte-44e98c0d-d613-4e91-9bf4-f841cc080bad" released by "delete_volume" :: held 0.877s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:57 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a.79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8" returned: 0 in 0.277s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Lock "cinder-quobyte-79d74e7a-a3b4-4898-a2d5-bb40bd9c12b8" released by "_delete_snapshot" :: held 1.934s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Created reservations ['988d349b-e70c-4809-8d7a-2cd0daf14a32', '751592ba-fee3-41ef-a8de-3231fafeed1c', 'd5278b4f-3895-47c1-b2ed-6256e2d4fd0d', '369a49fe-bced-4943-86d3-d5d614c2e256'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Lock "cinder-quobyte-b76f002a-c33c-4148-a1dd-a1bd4a29c34a" released by "delete_snapshot" :: held 1.971s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:57 devstack cinder-volume[87487]: WARNING cinder.quota [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-336570006 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-336570006, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:05:57 devstack cinder-volume[87487]: WARNING cinder.quota [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-336570006 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-336570006, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:05:57 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:05:57 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] Created reservations ['494f747c-df67-4b01-8eb8-0bd5b808df2e', 'eb1ec5fe-93ad-41ff-9ef9-5317604d483d', '17db6802-43e9-43f0-bb30-8379cc5964ea', '08e3d5ad-4e9d-4ca8-b177-befaab448193'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:57 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-e30edd8f-7abd-4c15-bf09-a16851d11494 tempest-GroupSnapshotsV319Test-1941491820 None] group_snapshot 50636681-1c36-4e0b-9157-5d602a361e37: deleted successfully Jul 21 19:05:57 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.248s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:57 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Deleted volume successfully. Jul 21 19:05:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5c4e48cc-ba0e-4db8-9d81-cbfec7ece3e7 tempest-SnapshotsActionsTest-1121244827 None] Lock "cinder-44e98c0d-d613-4e91-9bf4-f841cc080bad-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Acquiring lock "cinder-quobyte-b76f002a-c33c-4148-a1dd-a1bd4a29c34a" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Lock "cinder-quobyte-b76f002a-c33c-4148-a1dd-a1bd4a29c34a" acquired by "delete_volume" :: waited 0.034s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Acquiring lock "cinder-aa817fc9-0ea2-4861-afa2-1d0f0551a960-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:58 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d1e785-b290-4296-b7cf-25b07c462377]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Lock "cinder-aa817fc9-0ea2-4861-afa2-1d0f0551a960-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Acquiring lock "cinder-quobyte-aa817fc9-0ea2-4861-afa2-1d0f0551a960" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Lock "cinder-quobyte-aa817fc9-0ea2-4861-afa2-1d0f0551a960" acquired by "delete_volume" :: waited 0.039s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:58 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c68f89-1519-41ab-ac61-90115f3d8bd0]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:58 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a Jul 21 19:05:58 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:58 devstack sudo[93173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960 Jul 21 19:05:58 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:58 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a" returned: 0 in 0.564s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:58 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a Jul 21 19:05:58 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:59 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960" returned: 0 in 0.705s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:59 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960 Jul 21 19:05:59 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:59 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b76f002a-c33c-4148-a1dd-a1bd4a29c34a" returned: 0 in 0.642s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Lock "cinder-quobyte-b76f002a-c33c-4148-a1dd-a1bd4a29c34a" released by "delete_volume" :: held 1.310s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:59 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa817fc9-0ea2-4861-afa2-1d0f0551a960" returned: 0 in 0.477s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Lock "cinder-quobyte-aa817fc9-0ea2-4861-afa2-1d0f0551a960" released by "delete_volume" :: held 1.256s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Created reservations ['b6cfb3db-2507-4efb-a08c-f54799ee0784'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:59 devstack cinder-volume[87487]: WARNING cinder.quota [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-336570006 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-336570006, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Created reservations ['6c9b3d0e-50f8-47b9-a506-534ab74365b3', 'bab8a9b8-2b71-41ef-ac7d-05bb8002ba82', '77b2595a-2240-45cc-9e27-eb6033c98e67', 'e6a6fc30-f1bd-42b5-a0b0-5a6eb3853c7e'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Created reservations ['61f3eb68-cb52-4c22-b87b-ae14402b2e67', '9b323778-5687-4c92-86f1-541e2178f536', 'bccdf3c8-c518-4a31-b0df-4bcfff6c0eb4', '2d5440d4-89f3-4029-aab6-e7f3d9adb388'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:59 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:05:59 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:59 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:05:59 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:00 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.320s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:00 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:00 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-13637cbf-5849-4573-9e3b-79c63b345250 tempest-GroupSnapshotsV319Test-1941491820 None] Delete group completed successfully. Jul 21 19:06:00 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.432s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:00 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:00 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Deleted volume successfully. Jul 21 19:06:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-beef0b16-2790-4c3b-832b-4a02013a93c7 tempest-VolumesActionsTest-283955735 None] Lock "cinder-aa817fc9-0ea2-4861-afa2-1d0f0551a960-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Flow 'volume_create_manager' (62920805-f597-45ce-8cd2-c60374d69699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b060ef-cb1a-4818-a1f1-801b0512d98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b060ef-cb1a-4818-a1f1-801b0512d98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1000474294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c213ad46-5cf7-4b73-93a8-4e32344aa9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f802dfd8a18d4d889528b6a157997b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:01Z,use_quota=True,user_id='8134a9dccf46441f862e1735c5510ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914e460c-cf37-4932-be3a-b6a1d42299d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914e460c-cf37-4932-be3a-b6a1d42299d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f96266-fbf6-41a6-8bad-d56d7d325955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f96266-fbf6-41a6-8bad-d56d7d325955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c213ad46-5cf7-4b73-93a8-4e32344aa9a3', 'volume_name': 'volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260d364e-a3e3-4fa8-9d3d-852d7f7aded7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260d364e-a3e3-4fa8-9d3d-852d7f7aded7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4db204b-5929-476b-ae20-98cf410abb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:01 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Volume c213ad46-5cf7-4b73-93a8-4e32344aa9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3', 'volume_size': 1} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1000474294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c213ad46-5cf7-4b73-93a8-4e32344aa9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f802dfd8a18d4d889528b6a157997b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:01Z,use_quota=True,user_id='8134a9dccf46441f862e1735c5510ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Creating volume c213ad46-5cf7-4b73-93a8-4e32344aa9a3 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:01 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:06:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:01 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3 1073741824 Jul 21 19:06:01 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:02 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3 1073741824" returned: 0 in 0.642s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:02 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3 Jul 21 19:06:02 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:02 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3" returned: 0 in 0.269s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4db204b-5929-476b-ae20-98cf410abb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb28ee2-7868-4654-a5e6-4b12eadd00d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:02 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Volume volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3 (c213ad46-5cf7-4b73-93a8-4e32344aa9a3): created successfully Jul 21 19:06:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb28ee2-7868-4654-a5e6-4b12eadd00d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Flow 'volume_create_manager' (62920805-f597-45ce-8cd2-c60374d69699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:02 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a2540d78-b2ca-48a7-a06f-2cdb8883a557 tempest-VolumesActionsTest-1616583792 None] Created volume successfully. Jul 21 19:06:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "cinder-c213ad46-5cf7-4b73-93a8-4e32344aa9a3-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Lock "cinder-c213ad46-5cf7-4b73-93a8-4e32344aa9a3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "cinder-quobyte-c213ad46-5cf7-4b73-93a8-4e32344aa9a3" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Lock "cinder-quobyte-c213ad46-5cf7-4b73-93a8-4e32344aa9a3" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:04 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e48ecb7-6504-47c3-9eac-ee79d7f5f9f9]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:04 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3 Jul 21 19:06:04 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:04 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3" returned: 0 in 0.477s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:04 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3 Jul 21 19:06:04 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:05 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c213ad46-5cf7-4b73-93a8-4e32344aa9a3" returned: 0 in 0.383s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Lock "cinder-quobyte-c213ad46-5cf7-4b73-93a8-4e32344aa9a3" released by "delete_volume" :: held 0.925s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:05 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=126,cinder:INSERT=48,cinder:UPDATE=154,cinder:DELETE=13 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:06:05 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:UPDATE=162,cinder:SELECT=150,cinder:DELETE=11,cinder:INSERT=32 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:06:05 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Created reservations ['4b5ab90f-6d6f-4cf2-8ec8-27d4a7b36c50', 'e4e34a16-ffe5-4f75-959f-3761227affa6', '8da7b818-8972-4bba-8ab1-1f8c8a1a5b15', 'a165c192-c496-4087-9e8b-4fb03fe4a1a1'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:05 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:06:05 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:05 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.295s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:05 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Deleted volume successfully. Jul 21 19:06:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cc477757-33a3-4de8-84b4-6290a60f28c5 tempest-VolumesActionsTest-1616583792 None] Lock "cinder-c213ad46-5cf7-4b73-93a8-4e32344aa9a3-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Flow 'volume_create_manager' (b0463f18-cbfa-461c-a58b-bd41955dee5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac64cdd-74a0-4a1a-ad1f-cdc5f9692881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac64cdd-74a0-4a1a-ad1f-cdc5f9692881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-283993219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b9a4ed-3470-4ebb-9887-ef2d98471a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ce46e4a6944b67aa96e0fe75160432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:14Z,use_quota=True,user_id='d8ada9ed3af24fbcaa1f8d4d745589ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e070be4-ff94-4639-a403-19ac3a0baf47),volume_type_id=5e070be4-ff94-4639-a403-19ac3a0baf47)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bf1550-246e-4de7-bba1-c77fdeedbb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bf1550-246e-4de7-bba1-c77fdeedbb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b6a4bc-0574-48d6-a360-945791a8cd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b6a4bc-0574-48d6-a360-945791a8cd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b9a4ed-3470-4ebb-9887-ef2d98471a2c', 'volume_name': 'volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a985176f-9969-4cc8-a9eb-b533b8209713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a985176f-9969-4cc8-a9eb-b533b8209713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc01d561-9d20-4ef5-8647-8332e72c9108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:14 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Volume 73b9a4ed-3470-4ebb-9887-ef2d98471a2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c', 'volume_size': 1} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-283993219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b9a4ed-3470-4ebb-9887-ef2d98471a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ce46e4a6944b67aa96e0fe75160432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:14Z,use_quota=True,user_id='d8ada9ed3af24fbcaa1f8d4d745589ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e070be4-ff94-4639-a403-19ac3a0baf47),volume_type_id=5e070be4-ff94-4639-a403-19ac3a0baf47)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Creating volume 73b9a4ed-3470-4ebb-9887-ef2d98471a2c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:14 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:14 devstack sudo[93281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c 1073741824 Jul 21 19:06:14 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:14 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c 1073741824" returned: 0 in 0.529s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:14 devstack sudo[93288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c Jul 21 19:06:14 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:15 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c" returned: 0 in 0.387s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc01d561-9d20-4ef5-8647-8332e72c9108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67eba532-2f42-42bc-9f88-0e281c606d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:15 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Volume volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c (73b9a4ed-3470-4ebb-9887-ef2d98471a2c): created successfully Jul 21 19:06:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67eba532-2f42-42bc-9f88-0e281c606d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Flow 'volume_create_manager' (b0463f18-cbfa-461c-a58b-bd41955dee5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:15 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-7b4fed35-21c9-4d4c-a3f0-b13657dc0a57 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Created volume successfully. Jul 21 19:06:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4d57cff0-83e0-45a4-acd7-0a5e92389b19 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4d57cff0-83e0-45a4-acd7-0a5e92389b19 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4d57cff0-83e0-45a4-acd7-0a5e92389b19 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4d57cff0-83e0-45a4-acd7-0a5e92389b19 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4d57cff0-83e0-45a4-acd7-0a5e92389b19 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4d57cff0-83e0-45a4-acd7-0a5e92389b19 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:16 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:06:16 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:17 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4d57cff0-83e0-45a4-acd7-0a5e92389b19 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.622s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:17 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-4d57cff0-83e0-45a4-acd7-0a5e92389b19 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:17 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4d57cff0-83e0-45a4-acd7-0a5e92389b19 tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Retype volume completed successfully. Jul 21 19:06:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Acquiring lock "cinder-73b9a4ed-3470-4ebb-9887-ef2d98471a2c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:18 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2b84ecbe-00cc-42d3-927f-94c3eb847f12 tempest-GroupsTest-872495095 None] Group tempest-Group1-1120411801: creating Jul 21 19:06:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Lock "cinder-73b9a4ed-3470-4ebb-9887-ef2d98471a2c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:18 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2b84ecbe-00cc-42d3-927f-94c3eb847f12 tempest-GroupsTest-872495095 None] Group tempest-Group1-1120411801: created successfully Jul 21 19:06:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Acquiring lock "cinder-quobyte-73b9a4ed-3470-4ebb-9887-ef2d98471a2c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:18 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2b84ecbe-00cc-42d3-927f-94c3eb847f12 tempest-GroupsTest-872495095 None] Create group completed successfully. Jul 21 19:06:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Lock "cinder-quobyte-73b9a4ed-3470-4ebb-9887-ef2d98471a2c" acquired by "delete_volume" :: waited 0.032s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:19 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed1cc39-216b-4d2a-9e45-10eb86aeadf3]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:19 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c Jul 21 19:06:19 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:19 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c" returned: 0 in 0.578s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:19 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c Jul 21 19:06:19 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:19 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73b9a4ed-3470-4ebb-9887-ef2d98471a2c" returned: 0 in 0.307s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Lock "cinder-quobyte-73b9a4ed-3470-4ebb-9887-ef2d98471a2c" released by "delete_volume" :: held 0.958s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:20 devstack cinder-volume[87487]: WARNING cinder.quota [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:06:20 devstack cinder-volume[87487]: WARNING cinder.quota [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:06:20 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Created reservations ['b19e59ae-0f83-4932-9ba2-c7975a2939c6', '873e5c70-8ce9-4141-b200-24d25f94c8fa', '57461712-1b1c-4116-bd78-71050f09144d', '6b675d2c-94b7-4452-8c3b-7f4127a5079d'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:20 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2b321e60-aedb-4007-8d25-1c159c0310ee tempest-GroupsTest-872495095 None] Group tempest-Group2-1068537780: creating Jul 21 19:06:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:20 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2b321e60-aedb-4007-8d25-1c159c0310ee tempest-GroupsTest-872495095 None] Group tempest-Group2-1068537780: created successfully Jul 21 19:06:20 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2b321e60-aedb-4007-8d25-1c159c0310ee tempest-GroupsTest-872495095 None] Create group completed successfully. Jul 21 19:06:20 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:06:20 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:20 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.330s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:20 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:20 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Deleted volume successfully. Jul 21 19:06:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-57fc5cd1-89b9-4c28-9a6c-fc6b2093f00b tempest-VolumeRetypeWithoutMigrationTest-1049749861 None] Lock "cinder-73b9a4ed-3470-4ebb-9887-ef2d98471a2c-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Flow 'volume_create_manager' (90da1c49-2ae1-4125-933e-b146c93396d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6af8ae0-4fa0-4156-840c-d3dd9d6454a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6af8ae0-4fa0-4156-840c-d3dd9d6454a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-985591269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95ebce7c-7637-495c-8a01-67fd29307e73,host='devstack@QuobyteHD#QuobyteHD',id=afa2c752-1469-493a-b469-dad3e40dda96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec588fc0f9da4c6384bb7feb8d6c58f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:22Z,use_quota=True,user_id='3739958e353346abaae0960f5138f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf2a9853-668c-4ede-8881-2d35da1909f0),volume_type_id=bf2a9853-668c-4ede-8881-2d35da1909f0)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f2f6e2-6280-4158-a4cb-80766ed47799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f2f6e2-6280-4158-a4cb-80766ed47799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60b31fc-0610-4340-9aa6-6d58db932ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60b31fc-0610-4340-9aa6-6d58db932ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afa2c752-1469-493a-b469-dad3e40dda96', 'volume_name': 'volume-afa2c752-1469-493a-b469-dad3e40dda96', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2335b94b-06bc-4523-9aca-5b7fbc9d797b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2335b94b-06bc-4523-9aca-5b7fbc9d797b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb849f36-1927-4157-81d6-c7faa416c0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:22 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Volume afa2c752-1469-493a-b469-dad3e40dda96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afa2c752-1469-493a-b469-dad3e40dda96', 'volume_size': 1} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95ebce7c-7637-495c-8a01-67fd29307e73,created_at=2026-07-21T17:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-985591269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95ebce7c-7637-495c-8a01-67fd29307e73,host='devstack@QuobyteHD#QuobyteHD',id=afa2c752-1469-493a-b469-dad3e40dda96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec588fc0f9da4c6384bb7feb8d6c58f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:22Z,use_quota=True,user_id='3739958e353346abaae0960f5138f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf2a9853-668c-4ede-8881-2d35da1909f0),volume_type_id=bf2a9853-668c-4ede-8881-2d35da1909f0)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Creating volume afa2c752-1469-493a-b469-dad3e40dda96 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:22 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:06:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-afa2c752-1469-493a-b469-dad3e40dda96 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:22 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-afa2c752-1469-493a-b469-dad3e40dda96 1073741824 Jul 21 19:06:22 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:23 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-afa2c752-1469-493a-b469-dad3e40dda96 1073741824" returned: 0 in 0.832s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-afa2c752-1469-493a-b469-dad3e40dda96 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:23 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-afa2c752-1469-493a-b469-dad3e40dda96 Jul 21 19:06:23 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:24 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-afa2c752-1469-493a-b469-dad3e40dda96" returned: 0 in 0.650s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb849f36-1927-4157-81d6-c7faa416c0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa2c752-1469-493a-b469-dad3e40dda96', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc5e301-4c64-4e39-84c6-a517f01445b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:24 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Volume volume-afa2c752-1469-493a-b469-dad3e40dda96 (afa2c752-1469-493a-b469-dad3e40dda96): created successfully Jul 21 19:06:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc5e301-4c64-4e39-84c6-a517f01445b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Flow 'volume_create_manager' (90da1c49-2ae1-4125-933e-b146c93396d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:24 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-62a398e8-c744-4047-9611-38059540ace6 tempest-GroupsTest-872495095 None] Created volume successfully. Jul 21 19:06:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Acquiring lock "cinder-quobyte-afa2c752-1469-493a-b469-dad3e40dda96" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Lock "cinder-quobyte-afa2c752-1469-493a-b469-dad3e40dda96" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:26 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb77dde8-995b-4780-b27f-6fb3d51f7ea0]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-afa2c752-1469-493a-b469-dad3e40dda96 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:26 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-afa2c752-1469-493a-b469-dad3e40dda96 Jul 21 19:06:26 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:26 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-afa2c752-1469-493a-b469-dad3e40dda96" returned: 0 in 0.623s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-afa2c752-1469-493a-b469-dad3e40dda96 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:26 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-afa2c752-1469-493a-b469-dad3e40dda96 Jul 21 19:06:26 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:27 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-afa2c752-1469-493a-b469-dad3e40dda96" returned: 0 in 0.668s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Lock "cinder-quobyte-afa2c752-1469-493a-b469-dad3e40dda96" released by "delete_volume" :: held 1.352s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:27 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Created reservations ['e5df90ae-e648-4297-9f56-d078cbf1a59d'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:27 devstack cinder-volume[87487]: WARNING cinder.quota [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-647815997 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-647815997, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:06:27 devstack cinder-volume[87487]: WARNING cinder.quota [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-647815997 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-647815997, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:06:27 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Created reservations ['390a4bdf-94cc-4c3a-9a99-4df0ad0dc136', '270dc468-b02d-4d34-9a02-0e24592b5642', '9bbc56b0-4e3f-4030-aaf3-8cb1f82dbe68', '4d2384fd-64e9-4e32-85da-ec265fbd9185'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:27 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:06:27 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:28 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.344s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:28 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:28 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-748dece3-636a-414b-9abd-e5dea50e911f tempest-GroupsTest-872495095 None] Delete group completed successfully. Jul 21 19:06:29 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-2c9941a2-83f6-46ad-9e97-6149e31f477e tempest-GroupsTest-872495095 None] Created reservations ['de5a75cd-b500-4d68-83ba-6c73d6052155'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2c9941a2-83f6-46ad-9e97-6149e31f477e tempest-GroupsTest-872495095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2c9941a2-83f6-46ad-9e97-6149e31f477e tempest-GroupsTest-872495095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2c9941a2-83f6-46ad-9e97-6149e31f477e tempest-GroupsTest-872495095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2c9941a2-83f6-46ad-9e97-6149e31f477e tempest-GroupsTest-872495095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2c9941a2-83f6-46ad-9e97-6149e31f477e tempest-GroupsTest-872495095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2c9941a2-83f6-46ad-9e97-6149e31f477e tempest-GroupsTest-872495095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:29 devstack sudo[93465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:06:29 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:29 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2c9941a2-83f6-46ad-9e97-6149e31f477e tempest-GroupsTest-872495095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.581s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:29 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-2c9941a2-83f6-46ad-9e97-6149e31f477e tempest-GroupsTest-872495095 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:29 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2c9941a2-83f6-46ad-9e97-6149e31f477e tempest-GroupsTest-872495095 None] Delete group completed successfully. Jul 21 19:06:31 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-207b49e3-7e58-463a-97bc-9bcab8438c23 tempest-GroupsTest-872495095 None] Group tempest-GroupsTest-Group-205132126: creating Jul 21 19:06:31 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-207b49e3-7e58-463a-97bc-9bcab8438c23 tempest-GroupsTest-872495095 None] Group tempest-GroupsTest-Group-205132126: created successfully Jul 21 19:06:31 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-207b49e3-7e58-463a-97bc-9bcab8438c23 tempest-GroupsTest-872495095 None] Create group completed successfully. Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Flow 'volume_create_manager' (58bba5d8-9a87-4f9c-a1a2-7ea242d96175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f079dcb-a661-4930-adad-749ade07d58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f079dcb-a661-4930-adad-749ade07d58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-787563725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f5a1189-437e-4e61-87ae-3db0c12f3da3,host='devstack@QuobyteHD#QuobyteHD',id=38c40106-a7bf-4666-b75a-7d01537ff318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec588fc0f9da4c6384bb7feb8d6c58f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:34Z,use_quota=True,user_id='3739958e353346abaae0960f5138f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(719a7c33-4e94-4434-8aba-2712c960c01b),volume_type_id=719a7c33-4e94-4434-8aba-2712c960c01b)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f00eb75-0de8-466d-b866-d40c516a6bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f00eb75-0de8-466d-b866-d40c516a6bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d110a1a8-2c19-4b7b-b5fc-3b8aa58827a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d110a1a8-2c19-4b7b-b5fc-3b8aa58827a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c40106-a7bf-4666-b75a-7d01537ff318', 'volume_name': 'volume-38c40106-a7bf-4666-b75a-7d01537ff318', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a000ef-0f0d-4c56-a00d-624c1e56c456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a000ef-0f0d-4c56-a00d-624c1e56c456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2fa89e-3e77-4bf5-9881-f4bfc5a32406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:33 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Volume 38c40106-a7bf-4666-b75a-7d01537ff318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c40106-a7bf-4666-b75a-7d01537ff318', 'volume_size': 1} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1f5a1189-437e-4e61-87ae-3db0c12f3da3,created_at=2026-07-21T17:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-787563725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f5a1189-437e-4e61-87ae-3db0c12f3da3,host='devstack@QuobyteHD#QuobyteHD',id=38c40106-a7bf-4666-b75a-7d01537ff318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec588fc0f9da4c6384bb7feb8d6c58f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:34Z,use_quota=True,user_id='3739958e353346abaae0960f5138f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(719a7c33-4e94-4434-8aba-2712c960c01b),volume_type_id=719a7c33-4e94-4434-8aba-2712c960c01b)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Creating volume 38c40106-a7bf-4666-b75a-7d01537ff318 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:33 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:06:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-38c40106-a7bf-4666-b75a-7d01537ff318 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:33 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-38c40106-a7bf-4666-b75a-7d01537ff318 1073741824 Jul 21 19:06:33 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:34 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:34 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Flow 'volume_create_manager' (685378fe-8ecf-445b-9b5d-df1474b920cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec3bd86-aebf-46a2-b75e-9dd1a6167d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-38c40106-a7bf-4666-b75a-7d01537ff318 1073741824" returned: 0 in 0.742s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec3bd86-aebf-46a2-b75e-9dd1a6167d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-63387036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a1ccf1-80c8-4e27-873c-1845c9e21e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e1738248fb4493ba5956d372d803b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:35Z,use_quota=True,user_id='1c4d8e92714548139c82e695d995d086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f60010bf-63eb-4848-963b-86917b43b9be),volume_type_id=f60010bf-63eb-4848-963b-86917b43b9be)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a388cec-aa37-446d-9aa9-cc721bb052c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a388cec-aa37-446d-9aa9-cc721bb052c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88fae83-0d91-4a17-8156-2be505fbd76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88fae83-0d91-4a17-8156-2be505fbd76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a1ccf1-80c8-4e27-873c-1845c9e21e52', 'volume_name': 'volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd4e6ae-f1b4-4556-9d00-df65a6adca0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd4e6ae-f1b4-4556-9d00-df65a6adca0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52732eba-bd69-462e-8e90-a7277d8d8467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:34 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Volume 88a1ccf1-80c8-4e27-873c-1845c9e21e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52', 'volume_size': 1} Jul 21 19:06:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-38c40106-a7bf-4666-b75a-7d01537ff318 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:34 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-38c40106-a7bf-4666-b75a-7d01537ff318 Jul 21 19:06:34 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:35 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-38c40106-a7bf-4666-b75a-7d01537ff318" returned: 0 in 0.282s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-63387036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a1ccf1-80c8-4e27-873c-1845c9e21e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e1738248fb4493ba5956d372d803b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:35Z,use_quota=True,user_id='1c4d8e92714548139c82e695d995d086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f60010bf-63eb-4848-963b-86917b43b9be),volume_type_id=f60010bf-63eb-4848-963b-86917b43b9be)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Creating volume 88a1ccf1-80c8-4e27-873c-1845c9e21e52 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:35 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:35 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52 1073741824 Jul 21 19:06:35 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2fa89e-3e77-4bf5-9881-f4bfc5a32406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c40106-a7bf-4666-b75a-7d01537ff318', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e7907e-19de-491f-b6ad-dcab0c675243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:35 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Volume volume-38c40106-a7bf-4666-b75a-7d01537ff318 (38c40106-a7bf-4666-b75a-7d01537ff318): created successfully Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e7907e-19de-491f-b6ad-dcab0c675243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Flow 'volume_create_manager' (58bba5d8-9a87-4f9c-a1a2-7ea242d96175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:35 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-334770a0-0421-43b8-b404-55edb94e78cc tempest-GroupsTest-872495095 None] Created volume successfully. Jul 21 19:06:35 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52 1073741824" returned: 0 in 0.530s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:35 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52 Jul 21 19:06:35 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Flow 'volume_create_manager' (32bf92da-2b5f-4859-b438-8397eaa27684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d93a64-63fb-45c3-9679-b9ae03938d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d93a64-63fb-45c3-9679-b9ae03938d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1527716998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6624f6-ec2a-40a5-86d2-fc7ee1598d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768a2601e43b4852944cf37df28ff64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:36Z,use_quota=True,user_id='5acb2981a4b04afa811e6d07de3cd1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48a3284-4379-43eb-93cb-ee0749556589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48a3284-4379-43eb-93cb-ee0749556589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c46b02-c423-4db2-bd2c-19958b94d2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.image.glance [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Creating Keystone auth plugin from conf {{(pid=87487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:06:35 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52" returned: 0 in 0.277s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52732eba-bd69-462e-8e90-a7277d8d8467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d516fb15-635d-44e3-9ef4-9ea0bace224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:35 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Volume volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52 (88a1ccf1-80c8-4e27-873c-1845c9e21e52): created successfully Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d516fb15-635d-44e3-9ef4-9ea0bace224e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Flow 'volume_create_manager' (685378fe-8ecf-445b-9b5d-df1474b920cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:35 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-18583b7a-e9f7-4ef4-bf0c-6871f4dedc39 tempest-VolumeTypesAccessTest-1494319098 None] Created volume successfully. Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c46b02-c423-4db2-bd2c-19958b94d2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d6624f6-ec2a-40a5-86d2-fc7ee1598d97', 'volume_name': 'volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97', 'volume_size': 1, 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3621f130346745d7901341d043a6da99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'created_at': datetime.datetime(2026, 7, 21, 16, 56, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc66b18b-6093-4756-9dba-09c30714a99f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdd7f54-a734-445d-bc30-7cc143b9dfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdd7f54-a734-445d-bc30-7cc143b9dfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e4a1ad-a8c9-4aa4-b388-2ed5ac15efc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:36 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Volume 3d6624f6-ec2a-40a5-86d2-fc7ee1598d97: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97', 'volume_size': 1, 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3621f130346745d7901341d043a6da99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'created_at': datetime.datetime(2026, 7, 21, 16, 56, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc66b18b-6093-4756-9dba-09c30714a99f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Trying to clone 3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 from image cc66b18b-6093-4756-9dba-09c30714a99f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]). {{(pid=87487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Flow 'volume_create_manager' (b6dc468f-735e-47bc-a911-fb2d22dd83e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413fa700-789f-4de6-b4a7-54a90603e82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413fa700-789f-4de6-b4a7-54a90603e82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1384615823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c05b49e-007b-43f2-ac9b-19026a319faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f54194637940dcb9cebf06ff152d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:36Z,use_quota=True,user_id='9a0c180edff94644be69f3152289ea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc89e832-b632-4007-9cad-dec7004a256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc89e832-b632-4007-9cad-dec7004a256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d57d174-b2ee-434c-9deb-df58d99d1f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d57d174-b2ee-434c-9deb-df58d99d1f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c05b49e-007b-43f2-ac9b-19026a319faa', 'volume_name': 'volume-0c05b49e-007b-43f2-ac9b-19026a319faa', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f91cb0-37ec-4fef-b4e3-7dc61d2312ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f91cb0-37ec-4fef-b4e3-7dc61d2312ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4bf868c-58f0-4a12-abc9-b9e995f36651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:36 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Volume 0c05b49e-007b-43f2-ac9b-19026a319faa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c05b49e-007b-43f2-ac9b-19026a319faa', 'volume_size': 1} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1384615823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c05b49e-007b-43f2-ac9b-19026a319faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f54194637940dcb9cebf06ff152d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:36Z,use_quota=True,user_id='9a0c180edff94644be69f3152289ea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Creating volume 0c05b49e-007b-43f2-ac9b-19026a319faa {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:36 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0c05b49e-007b-43f2-ac9b-19026a319faa 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:36 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0c05b49e-007b-43f2-ac9b-19026a319faa 1073741824 Jul 21 19:06:36 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_89gwtmvudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:06:36 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Image download 20.69 MB at 20.69 MB/s Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Acquiring lock "cinder-88a1ccf1-80c8-4e27-873c-1845c9e21e52-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Lock "cinder-88a1ccf1-80c8-4e27-873c-1845c9e21e52-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[635d1f5f-fdf7-4f98-91ae-e683a4a0fa0c]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_89gwtmvudevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Flow 'volume_create_manager' (aa2c49ab-5b0f-4131-bbfe-a0353350f065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a53f0e-3242-4901-abab-aec56e14b860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Acquiring lock "cinder-quobyte-88a1ccf1-80c8-4e27-873c-1845c9e21e52" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a53f0e-3242-4901-abab-aec56e14b860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1951591880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f5a1189-437e-4e61-87ae-3db0c12f3da3,host='devstack@QuobyteHD#QuobyteHD',id=2d24a4c5-9c4a-414e-b034-916054b5c53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec588fc0f9da4c6384bb7feb8d6c58f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:37Z,use_quota=True,user_id='3739958e353346abaae0960f5138f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(719a7c33-4e94-4434-8aba-2712c960c01b),volume_type_id=719a7c33-4e94-4434-8aba-2712c960c01b)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:37 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_89gwtmvudevstack@QuobyteHD Jul 21 19:06:37 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a4b8ba-2c4a-4459-83ca-77a689e3654c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a4b8ba-2c4a-4459-83ca-77a689e3654c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18095b98-666b-48cb-b0a9-33e91f751677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18095b98-666b-48cb-b0a9-33e91f751677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d24a4c5-9c4a-414e-b034-916054b5c53d', 'volume_name': 'volume-2d24a4c5-9c4a-414e-b034-916054b5c53d', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a39750-a390-46af-8aa0-5ebc2d41dca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a39750-a390-46af-8aa0-5ebc2d41dca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aabbe13-6581-4024-83f8-a181a033de87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:37 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Volume 2d24a4c5-9c4a-414e-b034-916054b5c53d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d24a4c5-9c4a-414e-b034-916054b5c53d', 'volume_size': 1} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Lock "cinder-quobyte-88a1ccf1-80c8-4e27-873c-1845c9e21e52" acquired by "delete_volume" :: waited 0.070s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eca7b0-891c-4125-8fba-6ecf1bfc5535]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:37 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0c05b49e-007b-43f2-ac9b-19026a319faa 1073741824" returned: 0 in 0.594s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:37 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52 Jul 21 19:06:37 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0c05b49e-007b-43f2-ac9b-19026a319faa {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:37 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_89gwtmvudevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Temporary image cc66b18b-6093-4756-9dba-09c30714a99f is fetched for user 5acb2981a4b04afa811e6d07de3cd1a6. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:06:37 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0c05b49e-007b-43f2-ac9b-19026a319faa Jul 21 19:06:37 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefc0229-00a0-40fd-9d1c-dda02ffbf6d5]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_89gwtmvudevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:37 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_89gwtmvudevstack@QuobyteHD Jul 21 19:06:37 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:37 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52" returned: 0 in 0.391s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:37 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0c05b49e-007b-43f2-ac9b-19026a319faa" returned: 0 in 0.287s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.445s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1f5a1189-437e-4e61-87ae-3db0c12f3da3,created_at=2026-07-21T17:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1951591880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f5a1189-437e-4e61-87ae-3db0c12f3da3,host='devstack@QuobyteHD#QuobyteHD',id=2d24a4c5-9c4a-414e-b034-916054b5c53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec588fc0f9da4c6384bb7feb8d6c58f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:37Z,use_quota=True,user_id='3739958e353346abaae0960f5138f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(719a7c33-4e94-4434-8aba-2712c960c01b),volume_type_id=719a7c33-4e94-4434-8aba-2712c960c01b)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Creating volume 2d24a4c5-9c4a-414e-b034-916054b5c53d {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:37 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52 Jul 21 19:06:37 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2d24a4c5-9c4a-414e-b034-916054b5c53d 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:37 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:37 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2d24a4c5-9c4a-414e-b034-916054b5c53d 1073741824 Jul 21 19:06:37 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4bf868c-58f0-4a12-abc9-b9e995f36651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c05b49e-007b-43f2-ac9b-19026a319faa', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795f4b2f-bd79-4e7b-bec6-dc0a89e8c7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:37 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Volume volume-0c05b49e-007b-43f2-ac9b-19026a319faa (0c05b49e-007b-43f2-ac9b-19026a319faa): created successfully Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795f4b2f-bd79-4e7b-bec6-dc0a89e8c7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Flow 'volume_create_manager' (b6dc468f-735e-47bc-a911-fb2d22dd83e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:37 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4e5971ee-cd3b-4a62-a999-5464c6cb20d6 tempest-ServersNegativeTestJSON-1981471675 None] Created volume successfully. Jul 21 19:06:37 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_89gwtmvudevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:37 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-88a1ccf1-80c8-4e27-873c-1845c9e21e52" returned: 0 in 0.287s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Lock "cinder-quobyte-88a1ccf1-80c8-4e27-873c-1845c9e21e52" released by "delete_volume" :: held 0.715s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:37 devstack cinder-volume[87487]: WARNING cinder.quota [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1105879611 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1105879611, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:06:37 devstack cinder-volume[87487]: WARNING cinder.quota [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1105879611 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1105879611, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Created reservations ['a6750a56-366d-49e8-85df-c8c66c3757eb', 'a3ad788e-5235-4635-bd6a-a5cd6d6f9aff', 'b6530066-3cd4-480f-8f7d-aa86a8b61d5b', 'c3eff029-33f0-447e-94ab-cd9676bd61d0'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:37 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:06:37 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:38 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2d24a4c5-9c4a-414e-b034-916054b5c53d 1073741824" returned: 0 in 0.511s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2d24a4c5-9c4a-414e-b034-916054b5c53d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:38 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2d24a4c5-9c4a-414e-b034-916054b5c53d Jul 21 19:06:38 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:38 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.322s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:38 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Deleted volume successfully. Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-94c0baca-8c1f-414d-8cee-fd8cdd1d78b9 tempest-VolumeTypesAccessTest-1494319098 None] Lock "cinder-88a1ccf1-80c8-4e27-873c-1845c9e21e52-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:38 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2d24a4c5-9c4a-414e-b034-916054b5c53d" returned: 0 in 0.328s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.679s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1527716998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6624f6-ec2a-40a5-86d2-fc7ee1598d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768a2601e43b4852944cf37df28ff64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:36Z,use_quota=True,user_id='5acb2981a4b04afa811e6d07de3cd1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Creating volume 3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:38 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:38 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 1073741824 Jul 21 19:06:38 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aabbe13-6581-4024-83f8-a181a033de87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d24a4c5-9c4a-414e-b034-916054b5c53d', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab74f0d-dfce-4ba4-be1c-a25e6db7d574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:38 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Volume volume-2d24a4c5-9c4a-414e-b034-916054b5c53d (2d24a4c5-9c4a-414e-b034-916054b5c53d): created successfully Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab74f0d-dfce-4ba4-be1c-a25e6db7d574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Flow 'volume_create_manager' (aa2c49ab-5b0f-4131-bbfe-a0353350f065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:38 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-62303e25-3100-40ea-a79b-d7d28da4556c tempest-GroupsTest-872495095 None] Created volume successfully. Jul 21 19:06:39 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 1073741824" returned: 0 in 0.659s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:39 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 Jul 21 19:06:39 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:39 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-36a75e58-83cf-433e-9234-828488236c75 tempest-GroupsTest-872495095 None] Update group completed successfully. Jul 21 19:06:39 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97" returned: 0 in 0.434s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:39 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Attempting download of cc66b18b-6093-4756-9dba-09c30714a99f ((None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}])) to volume 3d6624f6-ec2a-40a5-86d2-fc7ee1598d97. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:06:39 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[badd6d54-266f-4fbe-8bca-22d23065a532]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_oe6wztck {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:39 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_oe6wztck Jul 21 19:06:39 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:40 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_oe6wztck" returned: 0 in 0.502s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_oe6wztck {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:40 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_oe6wztck Jul 21 19:06:40 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Flow 'volume_create_manager' (b17ec288-9cd5-4821-bdf9-93880bc9535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7929844-6635-4bbf-9d69-5721530c46ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7929844-6635-4bbf-9d69-5721530c46ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1333475251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18ad361-fcb3-46db-882f-be9989540881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f54194637940dcb9cebf06ff152d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:40Z,use_quota=True,user_id='9a0c180edff94644be69f3152289ea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49da3a41-8790-414e-90af-c6a63dcbf1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49da3a41-8790-414e-90af-c6a63dcbf1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a483c2-591a-44c2-9353-e53e794e5aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a483c2-591a-44c2-9353-e53e794e5aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18ad361-fcb3-46db-882f-be9989540881', 'volume_name': 'volume-b18ad361-fcb3-46db-882f-be9989540881', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cad05fa-3411-4647-a00c-071a9ba9e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cad05fa-3411-4647-a00c-071a9ba9e75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500d5329-2089-41a8-9fb3-ffc1ace72d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:40 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Volume b18ad361-fcb3-46db-882f-be9989540881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18ad361-fcb3-46db-882f-be9989540881', 'volume_size': 1} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1333475251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18ad361-fcb3-46db-882f-be9989540881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f54194637940dcb9cebf06ff152d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:40Z,use_quota=True,user_id='9a0c180edff94644be69f3152289ea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Creating volume b18ad361-fcb3-46db-882f-be9989540881 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:40 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b18ad361-fcb3-46db-882f-be9989540881 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:40 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b18ad361-fcb3-46db-882f-be9989540881 1073741824 Jul 21 19:06:40 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:06:40 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_oe6wztck" returned: 1 in 0.448s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_oe6wztck' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f507c7-446b-42b1-9f71-783f4b4e3ae7]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_89gwtmvudevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:40 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_89gwtmvudevstack@QuobyteHD Jul 21 19:06:40 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:41 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-af184cdf-5d95-4669-b4ec-2f7f9561ee78 tempest-GroupsTest-872495095 None] Update group completed successfully. Jul 21 19:06:41 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_89gwtmvudevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:41 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] cc66b18b-6093-4756-9dba-09c30714a99f was qcow2, converting to qcow2 {{(pid=87487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:06:41 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_89gwtmvudevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b18ad361-fcb3-46db-882f-be9989540881 1073741824" returned: 0 in 0.668s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:41 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_89gwtmvudevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 Jul 21 19:06:41 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b18ad361-fcb3-46db-882f-be9989540881 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:41 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b18ad361-fcb3-46db-882f-be9989540881 Jul 21 19:06:41 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:41 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b18ad361-fcb3-46db-882f-be9989540881" returned: 0 in 0.309s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500d5329-2089-41a8-9fb3-ffc1ace72d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18ad361-fcb3-46db-882f-be9989540881', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4735c7ec-1bea-496d-b0e1-a0335ac32432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:41 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Volume volume-b18ad361-fcb3-46db-882f-be9989540881 (b18ad361-fcb3-46db-882f-be9989540881): created successfully Jul 21 19:06:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4735c7ec-1bea-496d-b0e1-a0335ac32432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Flow 'volume_create_manager' (b17ec288-9cd5-4821-bdf9-93880bc9535d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:41 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-0373d9ba-a8cd-4346-a25c-6b82ff9fd64b tempest-ServersNegativeTestJSON-1981471675 None] Created volume successfully. Jul 21 19:06:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Acquiring lock "cinder-quobyte-2d24a4c5-9c4a-414e-b034-916054b5c53d" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Lock "cinder-quobyte-2d24a4c5-9c4a-414e-b034-916054b5c53d" acquired by "delete_volume" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:42 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb8ca40-6fd5-4a45-9dd3-4394bd22c2bd]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2d24a4c5-9c4a-414e-b034-916054b5c53d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:43 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2d24a4c5-9c4a-414e-b034-916054b5c53d Jul 21 19:06:43 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Acquiring lock "cinder-b18ad361-fcb3-46db-882f-be9989540881-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Lock "cinder-b18ad361-fcb3-46db-882f-be9989540881-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Acquiring lock "cinder-quobyte-b18ad361-fcb3-46db-882f-be9989540881" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Lock "cinder-quobyte-b18ad361-fcb3-46db-882f-be9989540881" acquired by "delete_volume" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fed792-489b-4404-a571-262076d8ade2]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b18ad361-fcb3-46db-882f-be9989540881 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:43 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2d24a4c5-9c4a-414e-b034-916054b5c53d" returned: 0 in 0.551s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2d24a4c5-9c4a-414e-b034-916054b5c53d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:43 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b18ad361-fcb3-46db-882f-be9989540881 Jul 21 19:06:43 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:43 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2d24a4c5-9c4a-414e-b034-916054b5c53d Jul 21 19:06:43 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:43 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_89gwtmvudevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97" returned: 0 in 2.359s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_89gwtmvudevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:06:43 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Converted 112.00 MB image at 47.45 MB/s Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:43 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 1G Jul 21 19:06:43 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:43 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b18ad361-fcb3-46db-882f-be9989540881" returned: 0 in 0.476s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b18ad361-fcb3-46db-882f-be9989540881 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:43 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2d24a4c5-9c4a-414e-b034-916054b5c53d" returned: 0 in 0.343s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:43 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b18ad361-fcb3-46db-882f-be9989540881 Jul 21 19:06:43 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Lock "cinder-quobyte-2d24a4c5-9c4a-414e-b034-916054b5c53d" released by "delete_volume" :: held 0.953s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Acquiring lock "cinder-quobyte-38c40106-a7bf-4666-b75a-7d01537ff318" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Lock "cinder-quobyte-38c40106-a7bf-4666-b75a-7d01537ff318" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bbce35-02d5-4576-9810-94acdf6e3667]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-38c40106-a7bf-4666-b75a-7d01537ff318 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:43 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-38c40106-a7bf-4666-b75a-7d01537ff318 Jul 21 19:06:43 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:44 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 1G" returned: 0 in 0.465s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Downloaded image cc66b18b-6093-4756-9dba-09c30714a99f ((None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}])) to volume 3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 successfully. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Temporary image cc66b18b-6093-4756-9dba-09c30714a99f for user 5acb2981a4b04afa811e6d07de3cd1a6 is deleted. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Marking volume 3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 as bootable. {{(pid=87487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:06:44 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b18ad361-fcb3-46db-882f-be9989540881" returned: 0 in 0.302s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Copying metadata from image cc66b18b-6093-4756-9dba-09c30714a99f to 3d6624f6-ec2a-40a5-86d2-fc7ee1598d97. {{(pid=87487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Creating volume glance metadata for volume 3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 backed by image cc66b18b-6093-4756-9dba-09c30714a99f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Lock "cinder-quobyte-b18ad361-fcb3-46db-882f-be9989540881" released by "delete_volume" :: held 0.858s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Created reservations ['b0c97bef-0ffe-4b04-a476-5c29a5cd59d0', '47a0fbd1-9408-418e-a5d0-acec12152cb5', '7c37c32d-8490-41c1-9cf1-c997a92ca276', 'bd0c7358-8f5a-4fc3-ba79-8a73cd9aa062'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e4a1ad-a8c9-4aa4-b388-2ed5ac15efc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97', 'volume_size': 1, 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3621f130346745d7901341d043a6da99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'created_at': datetime.datetime(2026, 7, 21, 16, 56, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc66b18b-6093-4756-9dba-09c30714a99f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354e0082-92bc-44f0-834b-7c8795ed37ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:44 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Volume volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 (3d6624f6-ec2a-40a5-86d2-fc7ee1598d97): created successfully Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354e0082-92bc-44f0-834b-7c8795ed37ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Flow 'volume_create_manager' (32bf92da-2b5f-4859-b438-8397eaa27684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:44 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4096fa82-7cda-43d7-a8ac-3ad6d34ccc75 tempest-VolumesImageMetadata-842867753 None] Created volume successfully. Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:44 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:06:44 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:44 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-38c40106-a7bf-4666-b75a-7d01537ff318" returned: 0 in 0.519s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-38c40106-a7bf-4666-b75a-7d01537ff318 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:44 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-38c40106-a7bf-4666-b75a-7d01537ff318 Jul 21 19:06:44 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:44 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.285s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:44 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Deleted volume successfully. Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-aec8bdad-d8ce-4b1e-8f53-3bb956002393 tempest-ServersNegativeTestJSON-1981471675 None] Lock "cinder-b18ad361-fcb3-46db-882f-be9989540881-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:44 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-38c40106-a7bf-4666-b75a-7d01537ff318" returned: 0 in 0.320s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Lock "cinder-quobyte-38c40106-a7bf-4666-b75a-7d01537ff318" released by "delete_volume" :: held 0.888s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Created reservations ['1a3e9006-9b07-44b4-82ca-d027956b1449'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:44 devstack cinder-volume[87487]: WARNING cinder.quota [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1511083139 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1511083139, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:06:44 devstack cinder-volume[87487]: WARNING cinder.quota [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1511083139 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1511083139, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Created reservations ['7561cc04-3135-48a5-9169-16c48efb8487', '4fb8ea1a-8e2f-48c4-be5d-d4bcdc5114cb', 'ce7ada8d-a3f3-4929-9a47-645c69e40ddc', '7a27a7a1-db51-4dff-add1-58c434279b3d'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Acquiring lock "cinder-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Lock "cinder-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Acquiring lock "cinder-quobyte-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Lock "cinder-quobyte-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed15a85-8a5f-4520-9587-49a2709082ae]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Created reservations ['6071c9a1-1306-4dc3-8b17-9800d7ceb04b', '9e60c1d6-d4e3-436e-84ce-a7c0d6a86662', '010e83c6-0b26-4077-bb68-1f2345c1be28', '5aba8b53-e27f-4261-8770-d006f5618d6e'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:45 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 Jul 21 19:06:45 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:45 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:06:45 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Acquiring lock "cinder-0c05b49e-007b-43f2-ac9b-19026a319faa-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Lock "cinder-0c05b49e-007b-43f2-ac9b-19026a319faa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:45 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97" returned: 0 in 0.507s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Acquiring lock "cinder-quobyte-0c05b49e-007b-43f2-ac9b-19026a319faa" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Lock "cinder-quobyte-0c05b49e-007b-43f2-ac9b-19026a319faa" acquired by "delete_volume" :: waited 0.040s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:45 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97 Jul 21 19:06:45 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:45 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.380s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:45 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-181aaf18-6752-488e-acb2-cbff0ce64152 tempest-GroupsTest-872495095 None] Delete group completed successfully. Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[740d8bd9-5158-46fa-b793-e80ad4cc3c75]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0c05b49e-007b-43f2-ac9b-19026a319faa {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:45 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0c05b49e-007b-43f2-ac9b-19026a319faa Jul 21 19:06:45 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:45 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97" returned: 0 in 0.285s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Lock "cinder-quobyte-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97" released by "delete_volume" :: held 0.851s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Created reservations ['e9596491-5eec-43dd-9b67-727baf3d582f', '48054138-97ad-431c-bee7-233d7e809b90', '80623467-79d9-4754-aba1-f05b8e8d7713', '2018398e-0b65-43b2-8c8a-32987bf533bb'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:46 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:06:46 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:46 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0c05b49e-007b-43f2-ac9b-19026a319faa" returned: 0 in 0.462s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0c05b49e-007b-43f2-ac9b-19026a319faa {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:46 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0c05b49e-007b-43f2-ac9b-19026a319faa Jul 21 19:06:46 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:46 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.314s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:46 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Deleted volume successfully. Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7f1062fe-a433-4cf6-aeab-69d7dd0075ae tempest-VolumesImageMetadata-842867753 None] Lock "cinder-3d6624f6-ec2a-40a5-86d2-fc7ee1598d97-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:46 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0c05b49e-007b-43f2-ac9b-19026a319faa" returned: 0 in 0.301s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Lock "cinder-quobyte-0c05b49e-007b-43f2-ac9b-19026a319faa" released by "delete_volume" :: held 0.830s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Created reservations ['cac74370-a1fa-444e-bcd9-2e44a7d2e677', '5f45cc4d-1f8e-43b9-9d49-617b31651f0f', 'a1103ca3-e579-4131-8ee1-4f518869d6b0', '44bae0cf-430a-4536-a21e-16e4bf4eb51f'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:46 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:06:46 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:46 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.383s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:46 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:46 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Deleted volume successfully. Jul 21 19:06:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bfeaf8cc-6f77-4004-9df0-a40f99445204 tempest-ServersNegativeTestJSON-1981471675 None] Lock "cinder-0c05b49e-007b-43f2-ac9b-19026a319faa-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Flow 'volume_create_manager' (99d6a57f-542b-413f-ba06-aa3b6198223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04753b71-4501-4238-9b5c-5a9a07dc67ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04753b71-4501-4238-9b5c-5a9a07dc67ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-198853171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567e55ff-1b89-4dd2-bb4e-fa035922896f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd34678a52145dc9b68b2abbc759b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:52Z,use_quota=True,user_id='6d013d8932ed4877945d0e586b42d9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b150b49-0761-42cd-971d-b8185e75c657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b150b49-0761-42cd-971d-b8185e75c657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d268df-ecdd-49bd-a0f1-e7270b832929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d268df-ecdd-49bd-a0f1-e7270b832929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '567e55ff-1b89-4dd2-bb4e-fa035922896f', 'volume_name': 'volume-567e55ff-1b89-4dd2-bb4e-fa035922896f', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a0bd45-95fc-428c-881d-ec98cfc8bacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a0bd45-95fc-428c-881d-ec98cfc8bacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9f3ae7-9423-4566-9a96-b23bba081d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:52 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Volume 567e55ff-1b89-4dd2-bb4e-fa035922896f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-567e55ff-1b89-4dd2-bb4e-fa035922896f', 'volume_size': 1} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-198853171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567e55ff-1b89-4dd2-bb4e-fa035922896f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd34678a52145dc9b68b2abbc759b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:52Z,use_quota=True,user_id='6d013d8932ed4877945d0e586b42d9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Creating volume 567e55ff-1b89-4dd2-bb4e-fa035922896f {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:52 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:06:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-567e55ff-1b89-4dd2-bb4e-fa035922896f 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:52 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-567e55ff-1b89-4dd2-bb4e-fa035922896f 1073741824 Jul 21 19:06:52 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:53 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-567e55ff-1b89-4dd2-bb4e-fa035922896f 1073741824" returned: 0 in 0.615s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-567e55ff-1b89-4dd2-bb4e-fa035922896f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:53 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-567e55ff-1b89-4dd2-bb4e-fa035922896f Jul 21 19:06:53 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:53 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-567e55ff-1b89-4dd2-bb4e-fa035922896f" returned: 0 in 0.426s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9f3ae7-9423-4566-9a96-b23bba081d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-567e55ff-1b89-4dd2-bb4e-fa035922896f', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367d2364-22ce-4ee2-8c5b-2ea7eb4abc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:53 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Volume volume-567e55ff-1b89-4dd2-bb4e-fa035922896f (567e55ff-1b89-4dd2-bb4e-fa035922896f): created successfully Jul 21 19:06:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367d2364-22ce-4ee2-8c5b-2ea7eb4abc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Flow 'volume_create_manager' (99d6a57f-542b-413f-ba06-aa3b6198223e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:53 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-1d6750ea-36ca-46d6-96aa-03c659313df7 tempest-AbsoluteLimitsTests-1269724592 None] Created volume successfully. Jul 21 19:06:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Acquiring lock "cinder-567e55ff-1b89-4dd2-bb4e-fa035922896f-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Lock "cinder-567e55ff-1b89-4dd2-bb4e-fa035922896f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Acquiring lock "cinder-quobyte-567e55ff-1b89-4dd2-bb4e-fa035922896f" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Lock "cinder-quobyte-567e55ff-1b89-4dd2-bb4e-fa035922896f" acquired by "delete_volume" :: waited 0.032s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:54 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c920751-20e1-41f5-a7f7-2112402dfa62]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-567e55ff-1b89-4dd2-bb4e-fa035922896f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:55 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-567e55ff-1b89-4dd2-bb4e-fa035922896f Jul 21 19:06:55 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Flow 'volume_create_manager' (61341b99-1b5b-418d-8f1a-f24277a54da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97b18d0-6d04-4392-a016-c78a3c1e71f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97b18d0-6d04-4392-a016-c78a3c1e71f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-466627057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c653cdcc-b573-49d8-bb0d-de57ef2a3abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a132aec3abe4ec9a324f0b277887eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:55Z,use_quota=True,user_id='e26f369038104cdfb3c1b3ab8833c293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87d47b2-e864-41d8-9c7b-110cf94e29c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87d47b2-e864-41d8-9c7b-110cf94e29c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5a642f-b4c5-44b5-99df-fdc79406f124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5a642f-b4c5-44b5-99df-fdc79406f124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c653cdcc-b573-49d8-bb0d-de57ef2a3abe', 'volume_name': 'volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843a0b48-2332-402b-b3f7-d94221273521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843a0b48-2332-402b-b3f7-d94221273521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b62c9b-d4aa-4edf-b8b0-fe572db7138f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:55 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Volume c653cdcc-b573-49d8-bb0d-de57ef2a3abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe', 'volume_size': 1} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-466627057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c653cdcc-b573-49d8-bb0d-de57ef2a3abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a132aec3abe4ec9a324f0b277887eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:55Z,use_quota=True,user_id='e26f369038104cdfb3c1b3ab8833c293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Creating volume c653cdcc-b573-49d8-bb0d-de57ef2a3abe {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:55 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:55 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-567e55ff-1b89-4dd2-bb4e-fa035922896f" returned: 0 in 0.509s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-567e55ff-1b89-4dd2-bb4e-fa035922896f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:55 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe 1073741824 Jul 21 19:06:55 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:55 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-567e55ff-1b89-4dd2-bb4e-fa035922896f Jul 21 19:06:55 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:55 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-567e55ff-1b89-4dd2-bb4e-fa035922896f" returned: 0 in 0.320s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Lock "cinder-quobyte-567e55ff-1b89-4dd2-bb4e-fa035922896f" released by "delete_volume" :: held 0.893s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Created reservations ['340d14e4-b2e2-4288-bb82-5120b0457b97', '1435b266-e73d-4381-922d-a235c044c260', '02b72180-b782-4b2d-8680-a8258e0de423', '0a62e411-34d2-481e-aea0-76b154512fe5'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:55 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:06:55 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:56 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe 1073741824" returned: 0 in 0.626s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:56 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe Jul 21 19:06:56 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:56 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.317s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:56 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:56 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Deleted volume successfully. Jul 21 19:06:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8e49eb81-1135-4866-b112-9d0ac404a4dd tempest-AbsoluteLimitsTests-1269724592 None] Lock "cinder-567e55ff-1b89-4dd2-bb4e-fa035922896f-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:56 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe" returned: 0 in 0.342s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b62c9b-d4aa-4edf-b8b0-fe572db7138f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4681d3a5-6e64-4830-b875-53c1b54d8fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:56 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Volume volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe (c653cdcc-b573-49d8-bb0d-de57ef2a3abe): created successfully Jul 21 19:06:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4681d3a5-6e64-4830-b875-53c1b54d8fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Flow 'volume_create_manager' (61341b99-1b5b-418d-8f1a-f24277a54da3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:56 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5c7c58e7-f93f-4403-bb90-9bf9e985585c tempest-VolumesListAdminTestJSON-1106119065 None] Created volume successfully. Jul 21 19:06:57 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Flow 'volume_create_manager' (b410aa7c-992b-44f0-b5a3-10b976ba9889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213105f7-7167-4fd2-8e85-5e065ee391bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213105f7-7167-4fd2-8e85-5e065ee391bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1382060319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce621d2-43b9-444b-b186-5a6f851e7999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a132aec3abe4ec9a324f0b277887eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:58Z,use_quota=True,user_id='e26f369038104cdfb3c1b3ab8833c293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2c5dbe-5e02-4bdf-a471-e7c20507b586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2c5dbe-5e02-4bdf-a471-e7c20507b586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6870c6-59de-4bab-b44f-c0a1e525660f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6870c6-59de-4bab-b44f-c0a1e525660f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce621d2-43b9-444b-b186-5a6f851e7999', 'volume_name': 'volume-dce621d2-43b9-444b-b186-5a6f851e7999', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6c9519-3129-46fe-ba3d-4bcae3487370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6c9519-3129-46fe-ba3d-4bcae3487370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df47aefa-39b4-444c-89d3-de9645c9c971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:58 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Volume dce621d2-43b9-444b-b186-5a6f851e7999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce621d2-43b9-444b-b186-5a6f851e7999', 'volume_size': 1} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1382060319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce621d2-43b9-444b-b186-5a6f851e7999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a132aec3abe4ec9a324f0b277887eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:58Z,use_quota=True,user_id='e26f369038104cdfb3c1b3ab8833c293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Creating volume dce621d2-43b9-444b-b186-5a6f851e7999 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:58 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dce621d2-43b9-444b-b186-5a6f851e7999 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:58 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dce621d2-43b9-444b-b186-5a6f851e7999 1073741824 Jul 21 19:06:58 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:58 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dce621d2-43b9-444b-b186-5a6f851e7999 1073741824" returned: 0 in 0.533s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dce621d2-43b9-444b-b186-5a6f851e7999 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:58 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dce621d2-43b9-444b-b186-5a6f851e7999 Jul 21 19:06:58 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:58 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dce621d2-43b9-444b-b186-5a6f851e7999" returned: 0 in 0.293s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df47aefa-39b4-444c-89d3-de9645c9c971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce621d2-43b9-444b-b186-5a6f851e7999', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad22919-2450-464e-8f20-0ea7b2d32b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:58 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Volume volume-dce621d2-43b9-444b-b186-5a6f851e7999 (dce621d2-43b9-444b-b186-5a6f851e7999): created successfully Jul 21 19:06:59 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad22919-2450-464e-8f20-0ea7b2d32b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:59 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Flow 'volume_create_manager' (b410aa7c-992b-44f0-b5a3-10b976ba9889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:59 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4ef62929-ac4d-43b3-9a95-5132e4be64fa tempest-VolumesListAdminTestJSON-1106119065 None] Created volume successfully. Jul 21 19:07:00 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Flow 'volume_create_manager' (ebb62b99-6bea-4305-8861-e3d03eb0171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cfc27a-1466-43b8-8999-9152c10ad976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cfc27a-1466-43b8-8999-9152c10ad976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-78524835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af04d0a-ca9a-45f6-ad87-78499643697a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a132aec3abe4ec9a324f0b277887eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:01Z,use_quota=True,user_id='e26f369038104cdfb3c1b3ab8833c293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e2d081-d9b5-4d28-aca6-fe256a8a0f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e2d081-d9b5-4d28-aca6-fe256a8a0f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2011bbf7-0e8f-4264-8fd5-e17a5b617c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2011bbf7-0e8f-4264-8fd5-e17a5b617c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2af04d0a-ca9a-45f6-ad87-78499643697a', 'volume_name': 'volume-2af04d0a-ca9a-45f6-ad87-78499643697a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd47cde-632d-495b-a558-ab1565b705e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd47cde-632d-495b-a558-ab1565b705e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5edd3761-3ff4-4aeb-af40-bcc92766d21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:01 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Volume 2af04d0a-ca9a-45f6-ad87-78499643697a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2af04d0a-ca9a-45f6-ad87-78499643697a', 'volume_size': 1} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-78524835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af04d0a-ca9a-45f6-ad87-78499643697a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a132aec3abe4ec9a324f0b277887eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:01Z,use_quota=True,user_id='e26f369038104cdfb3c1b3ab8833c293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Creating volume 2af04d0a-ca9a-45f6-ad87-78499643697a {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:01 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2af04d0a-ca9a-45f6-ad87-78499643697a 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:01 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2af04d0a-ca9a-45f6-ad87-78499643697a 1073741824 Jul 21 19:07:01 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:01 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2af04d0a-ca9a-45f6-ad87-78499643697a 1073741824" returned: 0 in 0.597s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2af04d0a-ca9a-45f6-ad87-78499643697a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:01 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2af04d0a-ca9a-45f6-ad87-78499643697a Jul 21 19:07:01 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:02 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2af04d0a-ca9a-45f6-ad87-78499643697a" returned: 0 in 0.348s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5edd3761-3ff4-4aeb-af40-bcc92766d21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2af04d0a-ca9a-45f6-ad87-78499643697a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f669ec7-3aaa-4841-9a12-bac3a7522434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:02 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Volume volume-2af04d0a-ca9a-45f6-ad87-78499643697a (2af04d0a-ca9a-45f6-ad87-78499643697a): created successfully Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f669ec7-3aaa-4841-9a12-bac3a7522434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Flow 'volume_create_manager' (ebb62b99-6bea-4305-8861-e3d03eb0171c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:02 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5b0c0404-b141-4831-bdbd-7083b0e21263 tempest-VolumesListAdminTestJSON-1106119065 None] Created volume successfully. Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Flow 'volume_create_manager' (775d2d2d-b123-4eed-b3ea-b2854571c297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1334f825-0185-44cf-ba2f-c7bb6c234ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1334f825-0185-44cf-ba2f-c7bb6c234ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-712020074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78a5931-d1ef-4007-95f8-aab36ecfee0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f01845b40742f498640df2e555b0ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:02Z,use_quota=True,user_id='03ac302ced1847409c9de6eaaa471ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126152a1-160a-433b-8d7d-00688dd3ccfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126152a1-160a-433b-8d7d-00688dd3ccfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802c330b-a385-4b66-93fc-dec1fe187a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802c330b-a385-4b66-93fc-dec1fe187a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f78a5931-d1ef-4007-95f8-aab36ecfee0c', 'volume_name': 'volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298cf631-5bda-4ed3-9862-448826d4c3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298cf631-5bda-4ed3-9862-448826d4c3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9052649a-aabf-45bd-a9e5-7d3cf1663c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:02 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Volume f78a5931-d1ef-4007-95f8-aab36ecfee0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c', 'volume_size': 1} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-712020074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78a5931-d1ef-4007-95f8-aab36ecfee0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f01845b40742f498640df2e555b0ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:02Z,use_quota=True,user_id='03ac302ced1847409c9de6eaaa471ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Creating volume f78a5931-d1ef-4007-95f8-aab36ecfee0c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:02 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:02 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c 1073741824 Jul 21 19:07:02 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:02 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c 1073741824" returned: 0 in 0.509s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:02 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c Jul 21 19:07:02 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:03 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c" returned: 0 in 0.310s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:03 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9052649a-aabf-45bd-a9e5-7d3cf1663c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:03 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849929af-caef-4807-8abf-754ff319475a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:03 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Volume volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c (f78a5931-d1ef-4007-95f8-aab36ecfee0c): created successfully Jul 21 19:07:03 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849929af-caef-4807-8abf-754ff319475a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:03 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Flow 'volume_create_manager' (775d2d2d-b123-4eed-b3ea-b2854571c297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:03 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c034caf5-3975-4e04-9c2f-28a326a3409e tempest-VolumesMetadataTest-2055009491 None] Created volume successfully. Jul 21 19:07:03 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Flow 'volume_create_manager' (aefb08e2-8aad-4721-94e8-74d0bbae7218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f4cce0-54ef-4f7e-8561-8494b1487eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f4cce0-54ef-4f7e-8561-8494b1487eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869d0f8b-2967-4f1d-a6c6-be03f124115a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96b2e695a0a4cafbcedfa7a25e380ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:04Z,use_quota=True,user_id='3dff8ab74a9d4d3a9326672c2036a43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3e4236-9302-4ce2-8d51-0a9f5126e9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3e4236-9302-4ce2-8d51-0a9f5126e9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcdfe1c7-6206-443b-8c19-d3e39cf2ce04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcdfe1c7-6206-443b-8c19-d3e39cf2ce04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869d0f8b-2967-4f1d-a6c6-be03f124115a', 'volume_name': 'volume-869d0f8b-2967-4f1d-a6c6-be03f124115a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a072925-f29a-4790-baee-5edcab93ee9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a072925-f29a-4790-baee-5edcab93ee9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185bb0f2-0abc-4e40-a149-dd6483399bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:04 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Volume 869d0f8b-2967-4f1d-a6c6-be03f124115a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869d0f8b-2967-4f1d-a6c6-be03f124115a', 'volume_size': 1} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869d0f8b-2967-4f1d-a6c6-be03f124115a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96b2e695a0a4cafbcedfa7a25e380ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:04Z,use_quota=True,user_id='3dff8ab74a9d4d3a9326672c2036a43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Creating volume 869d0f8b-2967-4f1d-a6c6-be03f124115a {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:04 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-869d0f8b-2967-4f1d-a6c6-be03f124115a 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:04 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-869d0f8b-2967-4f1d-a6c6-be03f124115a 1073741824 Jul 21 19:07:04 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:04 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-869d0f8b-2967-4f1d-a6c6-be03f124115a 1073741824" returned: 0 in 0.579s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-869d0f8b-2967-4f1d-a6c6-be03f124115a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:04 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-869d0f8b-2967-4f1d-a6c6-be03f124115a Jul 21 19:07:04 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:05 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-869d0f8b-2967-4f1d-a6c6-be03f124115a" returned: 0 in 0.290s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185bb0f2-0abc-4e40-a149-dd6483399bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869d0f8b-2967-4f1d-a6c6-be03f124115a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ca34ee-df32-4f87-82c5-d12775d816a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:05 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Volume volume-869d0f8b-2967-4f1d-a6c6-be03f124115a (869d0f8b-2967-4f1d-a6c6-be03f124115a): created successfully Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ca34ee-df32-4f87-82c5-d12775d816a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Flow 'volume_create_manager' (aefb08e2-8aad-4721-94e8-74d0bbae7218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-761a61f2-65fe-4a69-945c-ae053b8acbcf tempest-VolumesListAdminTestJSON-1021488334 None] Created volume successfully. Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Acquiring lock "cinder-f78a5931-d1ef-4007-95f8-aab36ecfee0c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Lock "cinder-f78a5931-d1ef-4007-95f8-aab36ecfee0c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=121,cinder:INSERT=32,cinder:UPDATE=124,cinder:DELETE=16 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:INSERT=38,cinder:UPDATE=158,cinder:SELECT=102,cinder:DELETE=5 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Acquiring lock "cinder-quobyte-f78a5931-d1ef-4007-95f8-aab36ecfee0c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Lock "cinder-quobyte-f78a5931-d1ef-4007-95f8-aab36ecfee0c" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad9d08c-9993-44e3-9ea2-38e846b55a1f]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:05 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c Jul 21 19:07:05 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:06 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c" returned: 0 in 0.454s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:06 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c Jul 21 19:07:06 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Acquiring lock "cinder-869d0f8b-2967-4f1d-a6c6-be03f124115a-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Lock "cinder-869d0f8b-2967-4f1d-a6c6-be03f124115a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Acquiring lock "cinder-quobyte-869d0f8b-2967-4f1d-a6c6-be03f124115a" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Lock "cinder-quobyte-869d0f8b-2967-4f1d-a6c6-be03f124115a" acquired by "delete_volume" :: waited 0.038s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "cinder-2af04d0a-ca9a-45f6-ad87-78499643697a-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70daa8a-cbe5-40e2-a4e0-9b67c3791897]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-869d0f8b-2967-4f1d-a6c6-be03f124115a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "cinder-2af04d0a-ca9a-45f6-ad87-78499643697a-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:06 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f78a5931-d1ef-4007-95f8-aab36ecfee0c" returned: 0 in 0.359s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Lock "cinder-quobyte-f78a5931-d1ef-4007-95f8-aab36ecfee0c" released by "delete_volume" :: held 0.875s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "cinder-quobyte-2af04d0a-ca9a-45f6-ad87-78499643697a" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:06 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-869d0f8b-2967-4f1d-a6c6-be03f124115a Jul 21 19:07:06 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "cinder-quobyte-2af04d0a-ca9a-45f6-ad87-78499643697a" acquired by "delete_volume" :: waited 0.032s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[321aabe9-f6d9-4f95-9d7c-1e31d7bbde54]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2af04d0a-ca9a-45f6-ad87-78499643697a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Created reservations ['3d572455-2a56-4d62-9c6e-b5c729d7f01a', '0652b85f-8859-40dd-8b24-89579f64d912', '5afeb2a9-b297-4940-b758-55e01fd5a963', '709995fd-1918-4aa5-85fa-8b9929f9e57b'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:06 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:06 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:06 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2af04d0a-ca9a-45f6-ad87-78499643697a Jul 21 19:07:06 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:06 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-869d0f8b-2967-4f1d-a6c6-be03f124115a" returned: 0 in 0.475s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-869d0f8b-2967-4f1d-a6c6-be03f124115a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:06 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-869d0f8b-2967-4f1d-a6c6-be03f124115a Jul 21 19:07:06 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:07 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2af04d0a-ca9a-45f6-ad87-78499643697a" returned: 0 in 0.555s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2af04d0a-ca9a-45f6-ad87-78499643697a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:07 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.432s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:07 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2af04d0a-ca9a-45f6-ad87-78499643697a Jul 21 19:07:07 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:07 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Deleted volume successfully. Jul 21 19:07:07 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5cd14704-a126-4cbf-aeda-20ffe1b5a77e tempest-VolumesMetadataTest-2055009491 None] Lock "cinder-f78a5931-d1ef-4007-95f8-aab36ecfee0c-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-869d0f8b-2967-4f1d-a6c6-be03f124115a" returned: 0 in 0.388s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Lock "cinder-quobyte-869d0f8b-2967-4f1d-a6c6-be03f124115a" released by "delete_volume" :: held 0.950s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Created reservations ['dc1cc0db-7768-4d0a-9702-d506a1a8c6ee', 'd1285185-5f64-4b51-8219-cb202aa3c318', 'eefdc9c5-66ae-4907-8ed9-49134bc14663', 'a0c11953-00a5-4401-8366-22e27463fede'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:07 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:07 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:07 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2af04d0a-ca9a-45f6-ad87-78499643697a" returned: 0 in 0.386s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "cinder-quobyte-2af04d0a-ca9a-45f6-ad87-78499643697a" released by "delete_volume" :: held 1.018s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Created reservations ['da2e04e8-92a7-4717-8fff-3f4251cd4b53', '79e5e30b-72f6-4fb5-b011-e02046a99216', '8a5b0b6f-f08b-4951-a555-e64aa69d43db', '28396db9-2828-46b4-8194-f426656eb5e9'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:07 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:07 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:07 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.462s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:07 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:07 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Deleted volume successfully. Jul 21 19:07:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f84e8a70-2278-4b11-b3d3-3e6786567ff8 tempest-VolumesListAdminTestJSON-1021488334 None] Lock "cinder-869d0f8b-2967-4f1d-a6c6-be03f124115a-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:08 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.296s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:08 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:08 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Deleted volume successfully. Jul 21 19:07:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b999ad81-b9d8-448c-91d7-61e2d9b3fcf3 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "cinder-2af04d0a-ca9a-45f6-ad87-78499643697a-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "cinder-dce621d2-43b9-444b-b186-5a6f851e7999-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "cinder-dce621d2-43b9-444b-b186-5a6f851e7999-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "cinder-quobyte-dce621d2-43b9-444b-b186-5a6f851e7999" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "cinder-quobyte-dce621d2-43b9-444b-b186-5a6f851e7999" acquired by "delete_volume" :: waited 0.036s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:09 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8da7baf-ff77-44ce-b08f-316c34ffbd49]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dce621d2-43b9-444b-b186-5a6f851e7999 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:09 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dce621d2-43b9-444b-b186-5a6f851e7999 Jul 21 19:07:09 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:09 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dce621d2-43b9-444b-b186-5a6f851e7999" returned: 0 in 0.399s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dce621d2-43b9-444b-b186-5a6f851e7999 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:09 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dce621d2-43b9-444b-b186-5a6f851e7999 Jul 21 19:07:09 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:09 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dce621d2-43b9-444b-b186-5a6f851e7999" returned: 0 in 0.386s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "cinder-quobyte-dce621d2-43b9-444b-b186-5a6f851e7999" released by "delete_volume" :: held 0.844s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:09 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Created reservations ['b45a4a8d-7ac9-497b-a6fd-ca9aabbad862', '80dbe360-0398-403e-9a62-7cb592010c4d', '3c00d52e-bfb2-4266-847b-d7e2aa46bec6', 'd4d52183-8d70-4dd4-b9ef-0fdcf754de18'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:10 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:10 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "cinder-c653cdcc-b573-49d8-bb0d-de57ef2a3abe-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Lock "cinder-c653cdcc-b573-49d8-bb0d-de57ef2a3abe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "cinder-quobyte-c653cdcc-b573-49d8-bb0d-de57ef2a3abe" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Lock "cinder-quobyte-c653cdcc-b573-49d8-bb0d-de57ef2a3abe" acquired by "delete_volume" :: waited 0.038s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[590b848a-36a7-4a39-bd98-83b41ab9e326]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:10 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.483s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:10 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Deleted volume successfully. Jul 21 19:07:10 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0695ea74-25d1-4f65-a9d1-eb865ad79106 tempest-VolumesListAdminTestJSON-1106119065 None] Lock "cinder-dce621d2-43b9-444b-b186-5a6f851e7999-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:10 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe Jul 21 19:07:10 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:11 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe" returned: 0 in 0.503s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:11 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe Jul 21 19:07:11 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:11 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c653cdcc-b573-49d8-bb0d-de57ef2a3abe" returned: 0 in 0.344s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Lock "cinder-quobyte-c653cdcc-b573-49d8-bb0d-de57ef2a3abe" released by "delete_volume" :: held 0.924s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:11 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Created reservations ['ec483d90-ca9b-4abc-82f6-67082ea7e87e', '371da338-459d-4d8b-a438-31f80826f31d', 'e2aaf1c8-5352-4d7f-8731-6157ba2aef58', '01035c56-36d4-4b32-92ec-d67cd57523ce'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:11 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:11 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:11 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.324s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:11 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:11 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Deleted volume successfully. Jul 21 19:07:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-93b0dbe5-b964-4745-bd4d-c99bf34e62ec tempest-VolumesListAdminTestJSON-1106119065 None] Lock "cinder-c653cdcc-b573-49d8-bb0d-de57ef2a3abe-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Flow 'volume_create_manager' (3e8aab34-f5dd-46b9-99a6-d0e37bca0b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238a94bc-d363-4a33-a33c-9ac605e439bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238a94bc-d363-4a33-a33c-9ac605e439bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1458326035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95608391-8a96-4cf8-b9bc-08d1b7ce9697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3135eed7687f470d9f7e598aea5a2035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:15Z,use_quota=True,user_id='fe873ba21383493894856ea4d9a9366f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b080da-8526-4e5c-97a1-778dbfd9021b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b080da-8526-4e5c-97a1-778dbfd9021b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3398f4d2-2d8d-451b-b2f6-1eb0a34a1248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3398f4d2-2d8d-451b-b2f6-1eb0a34a1248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95608391-8a96-4cf8-b9bc-08d1b7ce9697', 'volume_name': 'volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f53784d-7c14-4e9f-9ae8-6dda8ba5cebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f53784d-7c14-4e9f-9ae8-6dda8ba5cebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5edad618-3c29-45f6-a63d-5f828e4f8dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:15 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Volume 95608391-8a96-4cf8-b9bc-08d1b7ce9697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697', 'volume_size': 1} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1458326035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95608391-8a96-4cf8-b9bc-08d1b7ce9697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3135eed7687f470d9f7e598aea5a2035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:15Z,use_quota=True,user_id='fe873ba21383493894856ea4d9a9366f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Creating volume 95608391-8a96-4cf8-b9bc-08d1b7ce9697 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:15 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:15 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697 1073741824 Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:15 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Flow 'volume_create_manager' (e3645ef2-c00d-4858-9100-4ba93ae9841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ad63ec-1346-41c0-a6ba-6d94f2064a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ad63ec-1346-41c0-a6ba-6d94f2064a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1645457944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823afb92-db1a-4fae-8ea6-db368b42d991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f688ec546122423293fa706d975b93c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:15Z,use_quota=True,user_id='fd436b82716e4d4399d37537b49305d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc0ecfa-b704-47c0-9fc9-858ee34c0fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc0ecfa-b704-47c0-9fc9-858ee34c0fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a0b7ba-2c2c-4ba8-ad34-4037cda66a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a0b7ba-2c2c-4ba8-ad34-4037cda66a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '823afb92-db1a-4fae-8ea6-db368b42d991', 'volume_name': 'volume-823afb92-db1a-4fae-8ea6-db368b42d991', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b106b4-ea35-4ae8-bfe3-59bc41d43633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b106b4-ea35-4ae8-bfe3-59bc41d43633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6dbd84a-a413-48c2-b5fa-5983d5c61951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:15 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Volume 823afb92-db1a-4fae-8ea6-db368b42d991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-823afb92-db1a-4fae-8ea6-db368b42d991', 'volume_size': 1} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:15 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697 1073741824" returned: 0 in 0.696s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:16 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697 Jul 21 19:07:16 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:16 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697" returned: 0 in 0.384s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1645457944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823afb92-db1a-4fae-8ea6-db368b42d991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f688ec546122423293fa706d975b93c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:15Z,use_quota=True,user_id='fd436b82716e4d4399d37537b49305d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Creating volume 823afb92-db1a-4fae-8ea6-db368b42d991 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:16 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-823afb92-db1a-4fae-8ea6-db368b42d991 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5edad618-3c29-45f6-a63d-5f828e4f8dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f83304-d490-44b7-b372-829465067547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:16 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-823afb92-db1a-4fae-8ea6-db368b42d991 1073741824 Jul 21 19:07:16 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:16 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Volume volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697 (95608391-8a96-4cf8-b9bc-08d1b7ce9697): created successfully Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f83304-d490-44b7-b372-829465067547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Flow 'volume_create_manager' (3e8aab34-f5dd-46b9-99a6-d0e37bca0b5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:16 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-0242bf94-c94a-474a-aee5-8af640fe8b19 tempest-VolumesTransfersV355Test-1998928683 None] Created volume successfully. Jul 21 19:07:17 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-823afb92-db1a-4fae-8ea6-db368b42d991 1073741824" returned: 0 in 0.754s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-823afb92-db1a-4fae-8ea6-db368b42d991 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:17 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-823afb92-db1a-4fae-8ea6-db368b42d991 Jul 21 19:07:17 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:17 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-823afb92-db1a-4fae-8ea6-db368b42d991" returned: 0 in 0.302s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6dbd84a-a413-48c2-b5fa-5983d5c61951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-823afb92-db1a-4fae-8ea6-db368b42d991', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20b556e-3867-4f63-8b5d-3d867214f058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:17 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Volume volume-823afb92-db1a-4fae-8ea6-db368b42d991 (823afb92-db1a-4fae-8ea6-db368b42d991): created successfully Jul 21 19:07:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20b556e-3867-4f63-8b5d-3d867214f058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Flow 'volume_create_manager' (e3645ef2-c00d-4858-9100-4ba93ae9841e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:17 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-68018780-8eb9-4697-957b-212d895ccd88 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Created volume successfully. Jul 21 19:07:17 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9d79d9c4-14d9-4e37-a44b-7030e9e3e087 tempest-VolumesTransfersV355Test-129889181 None] Transfer volume completed successfully. Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Acquiring lock "cinder-823afb92-db1a-4fae-8ea6-db368b42d991-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Lock "cinder-823afb92-db1a-4fae-8ea6-db368b42d991-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Acquiring lock "cinder-quobyte-823afb92-db1a-4fae-8ea6-db368b42d991" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Lock "cinder-quobyte-823afb92-db1a-4fae-8ea6-db368b42d991" acquired by "delete_volume" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fa9b1b-e89e-46d0-9dd6-ca38f4fc3394]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-823afb92-db1a-4fae-8ea6-db368b42d991 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Flow 'volume_create_manager' (ef16c1b6-12d4-46b5-b215-40640d662ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615c74d1-5726-4e6d-9ea7-b54f099ea237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615c74d1-5726-4e6d-9ea7-b54f099ea237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1488539079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe9197b-5ee7-4a30-ab10-03d29b6d441c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e259976f3fae441ab16291e56f0f9164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:19Z,use_quota=True,user_id='4b8fd398f73a42219e67afeafa2c8065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:18 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-823afb92-db1a-4fae-8ea6-db368b42d991 Jul 21 19:07:18 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805aad57-2f18-4b28-aafd-c6c3b5637f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805aad57-2f18-4b28-aafd-c6c3b5637f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1474c2-19eb-497b-a561-5c7a9d545acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1474c2-19eb-497b-a561-5c7a9d545acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe9197b-5ee7-4a30-ab10-03d29b6d441c', 'volume_name': 'volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992081ba-2704-441f-bc55-162ed4e865e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992081ba-2704-441f-bc55-162ed4e865e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8665f7-861f-4719-9b32-cb2d218b1afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:18 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Volume dbe9197b-5ee7-4a30-ab10-03d29b6d441c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c', 'volume_size': 1} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1488539079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe9197b-5ee7-4a30-ab10-03d29b6d441c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e259976f3fae441ab16291e56f0f9164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:19Z,use_quota=True,user_id='4b8fd398f73a42219e67afeafa2c8065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Creating volume dbe9197b-5ee7-4a30-ab10-03d29b6d441c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:18 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Acquiring lock "cinder-95608391-8a96-4cf8-b9bc-08d1b7ce9697-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:18 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c 1073741824 Jul 21 19:07:18 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Lock "cinder-95608391-8a96-4cf8-b9bc-08d1b7ce9697-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Acquiring lock "cinder-quobyte-95608391-8a96-4cf8-b9bc-08d1b7ce9697" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Lock "cinder-quobyte-95608391-8a96-4cf8-b9bc-08d1b7ce9697" acquired by "delete_volume" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d415f8ec-8c68-4986-8e24-e8ddbd6fdf9b]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:19 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697 Jul 21 19:07:19 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:19 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-823afb92-db1a-4fae-8ea6-db368b42d991" returned: 0 in 0.544s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-823afb92-db1a-4fae-8ea6-db368b42d991 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:19 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-823afb92-db1a-4fae-8ea6-db368b42d991 Jul 21 19:07:19 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:19 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697" returned: 0 in 0.635s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:19 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697 Jul 21 19:07:19 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c 1073741824" returned: 0 in 0.881s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:19 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:19 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:19 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c Jul 21 19:07:19 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-823afb92-db1a-4fae-8ea6-db368b42d991" returned: 0 in 0.688s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Lock "cinder-quobyte-823afb92-db1a-4fae-8ea6-db368b42d991" released by "delete_volume" :: held 1.322s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Created reservations ['5960223d-188a-4526-953a-3bda261317c5', 'ea659b5d-97ae-49fc-9a99-9434dba906ee', '33011638-f463-4a2f-a1cc-a990e3e9c8ff', 'abb355f1-a9a5-428c-a73e-bd346e575561'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:20 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95608391-8a96-4cf8-b9bc-08d1b7ce9697" returned: 0 in 0.761s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Lock "cinder-quobyte-95608391-8a96-4cf8-b9bc-08d1b7ce9697" released by "delete_volume" :: held 1.462s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:20 devstack sudo[94033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:20 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:20 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c" returned: 0 in 0.647s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8665f7-861f-4719-9b32-cb2d218b1afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9cebaa-6986-4ecc-a049-36197f4d1386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:20 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Volume volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c (dbe9197b-5ee7-4a30-ab10-03d29b6d441c): created successfully Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9cebaa-6986-4ecc-a049-36197f4d1386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Flow 'volume_create_manager' (ef16c1b6-12d4-46b5-b215-40640d662ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Created reservations ['23876199-482c-4fa3-abdd-117c107864ad', '25f3425a-2909-4d37-aeb3-135e67ba2ab2', '725573ce-e1dd-41cf-af35-e9bb5151d3be', 'f07ad216-fbd5-4323-8e68-8891059f3c73'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:20 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-e399c9b0-f517-4483-8f95-35a81fb1a72e tempest-SnapshotMetadataTestJSON-853279078 None] Created volume successfully. Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:20 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:20 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:20 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.386s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:20 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Deleted volume successfully. Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-51b3e94e-3ae9-4f40-a6b9-a520130f9bb7 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Lock "cinder-823afb92-db1a-4fae-8ea6-db368b42d991-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:20 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.345s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:20 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:20 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Deleted volume successfully. Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8dbed5e7-0a42-49c2-af85-cf89920458f6 tempest-VolumesTransfersV355Test-859461137 None] Lock "cinder-95608391-8a96-4cf8-b9bc-08d1b7ce9697-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] Creating offline snapshot 16b3555c-609c-49af-b65d-36f4812cec0a of volume dbe9197b-5ee7-4a30-ab10-03d29b6d441c {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7d8ea0-4df5-4a00-8afc-21c0e72396b5]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:21 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c Jul 21 19:07:21 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Flow 'volume_create_manager' (4737e40c-944d-4d61-93e9-b62daf028ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754aea82-eee4-4104-a69b-faff10115ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754aea82-eee4-4104-a69b-faff10115ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1105077635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9c992c-e997-4aab-8821-f371fd5f7f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f688ec546122423293fa706d975b93c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:22Z,use_quota=True,user_id='fd436b82716e4d4399d37537b49305d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b1b509-9061-4e53-bfdc-8633c4da2084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b1b509-9061-4e53-bfdc-8633c4da2084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e125feca-7486-49f7-a0e8-f341348ce8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e125feca-7486-49f7-a0e8-f341348ce8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf9c992c-e997-4aab-8821-f371fd5f7f2f', 'volume_name': 'volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185331f8-ccef-4562-9ff8-2f36a7ba24fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185331f8-ccef-4562-9ff8-2f36a7ba24fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7323211d-b6fa-493b-9d9d-03ec1056785b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:22 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Volume bf9c992c-e997-4aab-8821-f371fd5f7f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f', 'volume_size': 1} Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:22 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c" returned: 0 in 0.721s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:22 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a 1G Jul 21 19:07:22 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Flow 'volume_create_manager' (f97792e0-db6c-4f07-9b33-3199d009708b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb2d19b-c94d-4ae1-8d1a-0a250906d7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb2d19b-c94d-4ae1-8d1a-0a250906d7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1452245433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8e2237-6fb8-421c-995b-4aa97db9a5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3135eed7687f470d9f7e598aea5a2035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:22Z,use_quota=True,user_id='fe873ba21383493894856ea4d9a9366f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cfb65a2-2291-45ba-89ce-eed38e3b04d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cfb65a2-2291-45ba-89ce-eed38e3b04d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a702fb9-6fe5-4dae-995e-da5a53d0dda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a702fb9-6fe5-4dae-995e-da5a53d0dda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c8e2237-6fb8-421c-995b-4aa97db9a5f6', 'volume_name': 'volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30c2b00-c5b7-4d23-9a76-11ee779a2c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30c2b00-c5b7-4d23-9a76-11ee779a2c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162e78d8-58df-45c4-af98-7b2d4333f5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:22 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Volume 7c8e2237-6fb8-421c-995b-4aa97db9a5f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6', 'volume_size': 1} Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:22 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a 1G" returned: 0 in 0.402s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:22 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a Jul 21 19:07:22 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:22 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a" returned: 0 in 0.343s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:22 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a is being set with open permissions: ugo+rw Jul 21 19:07:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:22 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a Jul 21 19:07:22 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:23 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a" returned: 0 in 0.253s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:23 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.info Jul 21 19:07:23 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:23 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.info" returned: 0 in 0.294s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:23 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.info is being set with open permissions: ugo+rw Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:23 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.info Jul 21 19:07:23 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:23 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.info" returned: 0 in 0.304s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.805s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1105077635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9c992c-e997-4aab-8821-f371fd5f7f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f688ec546122423293fa706d975b93c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:22Z,use_quota=True,user_id='fd436b82716e4d4399d37537b49305d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Creating volume bf9c992c-e997-4aab-8821-f371fd5f7f2f {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:23 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:23 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f 1073741824 Jul 21 19:07:23 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:23 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-305604ef-482e-4ff0-a399-fe1f5ba2747e tempest-SnapshotMetadataTestJSON-853279078 None] Create snapshot completed successfully Jul 21 19:07:24 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f 1073741824" returned: 0 in 0.508s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:24 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f Jul 21 19:07:24 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:24 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f" returned: 0 in 0.318s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.398s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1452245433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8e2237-6fb8-421c-995b-4aa97db9a5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3135eed7687f470d9f7e598aea5a2035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:22Z,use_quota=True,user_id='fe873ba21383493894856ea4d9a9366f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Creating volume 7c8e2237-6fb8-421c-995b-4aa97db9a5f6 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:24 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7323211d-b6fa-493b-9d9d-03ec1056785b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770240ef-fc9a-48f3-87ed-8e8caf1ee299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:24 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6 1073741824 Jul 21 19:07:24 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:24 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Volume volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f (bf9c992c-e997-4aab-8821-f371fd5f7f2f): created successfully Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770240ef-fc9a-48f3-87ed-8e8caf1ee299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Flow 'volume_create_manager' (4737e40c-944d-4d61-93e9-b62daf028ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:24 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f48bb95e-c845-484c-ae41-6a4e58c98d18 tempest-VolumeQuotasAdminTestJSON-1214078217 None] Created volume successfully. Jul 21 19:07:25 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Acquiring lock "cinder-16b3555c-609c-49af-b65d-36f4812cec0a-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6 1073741824" returned: 0 in 0.607s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Lock "cinder-16b3555c-609c-49af-b65d-36f4812cec0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Acquiring lock "cinder-quobyte-dbe9197b-5ee7-4a30-ab10-03d29b6d441c" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Lock "cinder-quobyte-dbe9197b-5ee7-4a30-ab10-03d29b6d441c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Acquiring lock "cinder-quobyte-16b3555c-609c-49af-b65d-36f4812cec0a" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Lock "cinder-quobyte-16b3555c-609c-49af-b65d-36f4812cec0a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Deleting offline snapshot 16b3555c-609c-49af-b65d-36f4812cec0a of volume dbe9197b-5ee7-4a30-ab10-03d29b6d441c {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:07:25 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6 Jul 21 19:07:25 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] snapshot_file for this snap is: volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7ed850-7cd7-4072-91bd-b75998b04345]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:25 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a Jul 21 19:07:25 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:25 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6" returned: 0 in 0.332s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162e78d8-58df-45c4-af98-7b2d4333f5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b119e3-123b-41e2-bd13-86a25f8d8e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:25 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Volume volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6 (7c8e2237-6fb8-421c-995b-4aa97db9a5f6): created successfully Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b119e3-123b-41e2-bd13-86a25f8d8e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Flow 'volume_create_manager' (f97792e0-db6c-4f07-9b33-3199d009708b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-703bf4eb-6f5f-4d58-b922-53ba19d99490 tempest-VolumesTransfersV355Test-1998928683 None] Created volume successfully. Jul 21 19:07:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-186627a5-c90e-4d22-951f-c045cc2510dc tempest-VolumeQuotasAdminTestJSON-1642637307 None] Transfer volume completed successfully. Jul 21 19:07:25 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a" returned: 0 in 0.506s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3806944-e77b-4655-8714-7d2560c5ed67]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:26 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c Jul 21 19:07:26 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Acquiring lock "cinder-bf9c992c-e997-4aab-8821-f371fd5f7f2f-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Lock "cinder-bf9c992c-e997-4aab-8821-f371fd5f7f2f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:26 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c" returned: 0 in 0.469s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Acquiring lock "cinder-quobyte-bf9c992c-e997-4aab-8821-f371fd5f7f2f" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:26 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a Jul 21 19:07:26 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Lock "cinder-quobyte-bf9c992c-e997-4aab-8821-f371fd5f7f2f" acquired by "delete_volume" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e333c1a-683c-4d40-9c2c-781534e9e4e3]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:26 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f Jul 21 19:07:26 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Acquiring lock "cinder-7c8e2237-6fb8-421c-995b-4aa97db9a5f6-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Lock "cinder-7c8e2237-6fb8-421c-995b-4aa97db9a5f6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:26 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a" returned: 0 in 0.473s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:26 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a Jul 21 19:07:26 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Acquiring lock "cinder-quobyte-7c8e2237-6fb8-421c-995b-4aa97db9a5f6" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Lock "cinder-quobyte-7c8e2237-6fb8-421c-995b-4aa97db9a5f6" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[555ffd1a-71e3-40fc-ad5d-76ad76f0a1ad]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:27 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f" returned: 0 in 0.522s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:27 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f Jul 21 19:07:27 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:27 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6 Jul 21 19:07:27 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:27 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c.16b3555c-609c-49af-b65d-36f4812cec0a" returned: 0 in 0.313s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Lock "cinder-quobyte-16b3555c-609c-49af-b65d-36f4812cec0a" released by "_delete_snapshot" :: held 1.911s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Lock "cinder-quobyte-dbe9197b-5ee7-4a30-ab10-03d29b6d441c" released by "delete_snapshot" :: held 1.945s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:27 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bf9c992c-e997-4aab-8821-f371fd5f7f2f" returned: 0 in 0.250s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Lock "cinder-quobyte-bf9c992c-e997-4aab-8821-f371fd5f7f2f" released by "delete_volume" :: held 0.823s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Created reservations ['f9c0746d-804f-4601-9959-3bdca11326e5', '7ea415c8-ed6a-4633-b5a2-6968fecc714d', '91912268-58f1-41e7-9067-4edb8eaf6688', '5906e73b-2e8f-46f6-a1f6-7d8271019af3'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Created reservations ['1de6ac17-a339-49ae-ab34-137cb7781346', 'b8cc90b4-aa57-4351-9dfe-e93c77965d0f', '8093e493-a4a1-4682-b3ab-6ec45e458607', 'fdcdb19c-4992-4c5d-8dae-36034a66e07a'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:27 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6" returned: 0 in 0.412s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:27 devstack sudo[94123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6 Jul 21 19:07:27 devstack sudo[94123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:27 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Delete snapshot completed successfully. Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8785c81f-e175-49d2-982f-df83547352ba tempest-SnapshotMetadataTestJSON-853279078 None] Lock "cinder-16b3555c-609c-49af-b65d-36f4812cec0a-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:27 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:27 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:27 devstack sudo[94123]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7c8e2237-6fb8-421c-995b-4aa97db9a5f6" returned: 0 in 0.311s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Lock "cinder-quobyte-7c8e2237-6fb8-421c-995b-4aa97db9a5f6" released by "delete_volume" :: held 0.780s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Created reservations ['12822b5e-d2ac-4943-a202-883b0d6d54ed', 'a80eebb2-c07a-4b3e-86ef-e7c265e87fa2', '021f4b7a-fa3d-4b97-b0a2-6088ec0e954a', '508346df-f30e-4821-9157-31cf68802ed5'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:27 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.334s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:27 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Deleted volume successfully. Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-012ebb80-691f-4783-8320-90005e399bfa tempest-VolumeQuotasAdminTestJSON-1696359771 None] Lock "cinder-bf9c992c-e997-4aab-8821-f371fd5f7f2f-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:27 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:27 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:28 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.357s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:28 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:28 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Deleted volume successfully. Jul 21 19:07:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d550cc5d-09cb-4cf1-ac90-892d4a2e4f8b tempest-VolumesTransfersV355Test-859461137 None] Lock "cinder-7c8e2237-6fb8-421c-995b-4aa97db9a5f6-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Acquiring lock "cinder-dbe9197b-5ee7-4a30-ab10-03d29b6d441c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Lock "cinder-dbe9197b-5ee7-4a30-ab10-03d29b6d441c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Acquiring lock "cinder-quobyte-dbe9197b-5ee7-4a30-ab10-03d29b6d441c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Lock "cinder-quobyte-dbe9197b-5ee7-4a30-ab10-03d29b6d441c" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:28 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3868dbfd-600f-472b-bea0-810c4d8cdf28]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:29 devstack sudo[94132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c Jul 21 19:07:29 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:29 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c" returned: 0 in 0.477s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:29 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c Jul 21 19:07:29 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:29 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dbe9197b-5ee7-4a30-ab10-03d29b6d441c" returned: 0 in 0.311s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Lock "cinder-quobyte-dbe9197b-5ee7-4a30-ab10-03d29b6d441c" released by "delete_volume" :: held 0.858s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:29 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Created reservations ['51b9f64d-d6ee-4f64-ad8d-ee0c0ea2a9e9', '7a7d43f6-e571-43e4-a867-f1ac200083b6', '7aecafd0-63b4-4944-a592-1dc578a47782', '7daa2f9d-9dfe-4a91-b19f-277948ef7620'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:30 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:30 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:30 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.475s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:30 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:30 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Deleted volume successfully. Jul 21 19:07:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b614d0e9-2b79-4470-9c27-5dc6dc77788c tempest-SnapshotMetadataTestJSON-853279078 None] Lock "cinder-dbe9197b-5ee7-4a30-ab10-03d29b6d441c-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Flow 'volume_create_manager' (726eff49-3ae8-4e56-90af-6d671fdab56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e6ec57-c28e-4a3f-8523-205b16116747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e6ec57-c28e-4a3f-8523-205b16116747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-428578354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6db07cc-5fea-426e-8af2-8f371beafde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6308e6a9f1894116aa68883fba73e1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:35Z,use_quota=True,user_id='6dacd66a13684a10b42e149929a224f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde6d45d-ae36-40d2-947a-c0d70f10f000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde6d45d-ae36-40d2-947a-c0d70f10f000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1200d8-0bea-4ff3-adc1-2f8d1343cbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1200d8-0bea-4ff3-adc1-2f8d1343cbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6db07cc-5fea-426e-8af2-8f371beafde4', 'volume_name': 'volume-f6db07cc-5fea-426e-8af2-8f371beafde4', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261f141f-857b-403e-ae2c-605dac1ca702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261f141f-857b-403e-ae2c-605dac1ca702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcebe9f9-c00d-48a5-9e59-d9e7bf22b3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:34 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Volume f6db07cc-5fea-426e-8af2-8f371beafde4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6db07cc-5fea-426e-8af2-8f371beafde4', 'volume_size': 1} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-428578354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6db07cc-5fea-426e-8af2-8f371beafde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6308e6a9f1894116aa68883fba73e1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:35Z,use_quota=True,user_id='6dacd66a13684a10b42e149929a224f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Creating volume f6db07cc-5fea-426e-8af2-8f371beafde4 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:34 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:34 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 1073741824 Jul 21 19:07:34 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:35 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 1073741824" returned: 0 in 0.486s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:35 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 Jul 21 19:07:35 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:35 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4" returned: 0 in 0.275s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcebe9f9-c00d-48a5-9e59-d9e7bf22b3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6db07cc-5fea-426e-8af2-8f371beafde4', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92270658-5fd6-492f-86e9-312d12422cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:35 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Volume volume-f6db07cc-5fea-426e-8af2-8f371beafde4 (f6db07cc-5fea-426e-8af2-8f371beafde4): created successfully Jul 21 19:07:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92270658-5fd6-492f-86e9-312d12422cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Flow 'volume_create_manager' (726eff49-3ae8-4e56-90af-6d671fdab56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:35 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-79e47c23-be31-4385-a8d4-d67760570fae tempest-VolumesCloneTest-1078396909 None] Created volume successfully. Jul 21 19:07:36 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Flow 'volume_create_manager' (349b27dd-3286-4613-bb0d-2ccdd43f7cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7f98a5-9872-495d-aea0-1d2f2ceb3a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7f98a5-9872-495d-aea0-1d2f2ceb3a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1188801815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1f2872-05af-41a3-89a1-0325d8c2cde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4801d51ea40d4366881cea2d0ee7a848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:37Z,use_quota=True,user_id='1f10f3bcd784415d99a648263f5281d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928ac6df-e104-4e10-b4f6-497df589bde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928ac6df-e104-4e10-b4f6-497df589bde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0808ea24-972c-418a-bcc3-b23e761ee870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0808ea24-972c-418a-bcc3-b23e761ee870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d1f2872-05af-41a3-89a1-0325d8c2cde1', 'volume_name': 'volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13056e36-d8f1-4486-a187-b38c637b16aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13056e36-d8f1-4486-a187-b38c637b16aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98a27cd-20a7-404f-832a-a8bd8fa17428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Volume 9d1f2872-05af-41a3-89a1-0325d8c2cde1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1', 'volume_size': 1} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1188801815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1f2872-05af-41a3-89a1-0325d8c2cde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4801d51ea40d4366881cea2d0ee7a848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:37Z,use_quota=True,user_id='1f10f3bcd784415d99a648263f5281d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Creating volume 9d1f2872-05af-41a3-89a1-0325d8c2cde1 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:37 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:37 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1 1073741824 Jul 21 19:07:37 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Flow 'volume_create_manager' (4efcd4fd-0068-4ad7-b787-023e991a4a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21fd875-e670-4373-a575-1d8f3a5dce43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21fd875-e670-4373-a575-1d8f3a5dce43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1373416897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114e12d5-343d-435d-baa2-5fa669b0652c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6308e6a9f1894116aa68883fba73e1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f6db07cc-5fea-426e-8af2-8f371beafde4,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:37Z,use_quota=True,user_id='6dacd66a13684a10b42e149929a224f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a213c102-88f0-4783-9e0d-2cc7b8b829e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a213c102-88f0-4783-9e0d-2cc7b8b829e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de5bfdd-5dfd-4c78-98a1-611fe08a6ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de5bfdd-5dfd-4c78-98a1-611fe08a6ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '114e12d5-343d-435d-baa2-5fa669b0652c', 'volume_name': 'volume-114e12d5-343d-435d-baa2-5fa669b0652c', 'volume_size': 2, 'source_volid': 'f6db07cc-5fea-426e-8af2-8f371beafde4', 'source_volstatus': 'available'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0cfe28-39ee-4f52-a249-331c5a80eafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0cfe28-39ee-4f52-a249-331c5a80eafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e78cf2-4ca4-497a-990d-d40c95b6b543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Volume 114e12d5-343d-435d-baa2-5fa669b0652c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-114e12d5-343d-435d-baa2-5fa669b0652c', 'volume_size': 2, 'source_volid': 'f6db07cc-5fea-426e-8af2-8f371beafde4', 'source_volstatus': 'available'} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:37 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1 1073741824" returned: 0 in 0.539s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:37 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1 Jul 21 19:07:37 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Flow 'volume_create_manager' (70e79e70-4956-40a1-aa75-745c6295ecfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0936dc23-ec8b-4fb3-8353-030e24253830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1" returned: 0 in 0.273s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.425s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:37 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Cloning volume f6db07cc-5fea-426e-8af2-8f371beafde4 to volume 114e12d5-343d-435d-baa2-5fa669b0652c Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0936dc23-ec8b-4fb3-8353-030e24253830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-736480889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95af0bbd-b597-4219-bbd6-607d68fdd40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c310b2058b98480f90e7c8fbd91ed2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:38Z,use_quota=True,user_id='b977a7612ddc49d5b8dcc6d54df0ee6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f32992-8039-42c0-a486-5093fded2e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f32992-8039-42c0-a486-5093fded2e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc66758-bb5f-459c-828c-e000e02d1484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc66758-bb5f-459c-828c-e000e02d1484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95af0bbd-b597-4219-bbd6-607d68fdd40c', 'volume_name': 'volume-95af0bbd-b597-4219-bbd6-607d68fdd40c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f8ea82-de9d-4b91-82f7-347a9ad31c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f8ea82-de9d-4b91-82f7-347a9ad31c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53845344-750d-4f63-aaf7-52dd02b6fe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:38 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Volume 95af0bbd-b597-4219-bbd6-607d68fdd40c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95af0bbd-b597-4219-bbd6-607d68fdd40c', 'volume_size': 1} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98a27cd-20a7-404f-832a-a8bd8fa17428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7918c8d-7e9a-4273-8666-9ef287aaebf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:38 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Volume volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1 (9d1f2872-05af-41a3-89a1-0325d8c2cde1): created successfully Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7918c8d-7e9a-4273-8666-9ef287aaebf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Flow 'volume_create_manager' (349b27dd-3286-4613-bb0d-2ccdd43f7cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:38 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-917fbb2e-d56d-4b92-8913-e4a507e34e01 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Created volume successfully. Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Creating offline snapshot a137ee18-4815-4125-881e-0dfd859c330e of volume f6db07cc-5fea-426e-8af2-8f371beafde4 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0beafd-b8ac-4b1e-87e1-cdc4d345f254]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:38 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 Jul 21 19:07:38 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:38 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4" returned: 0 in 0.334s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:38 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e 1G Jul 21 19:07:38 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:38 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e 1G" returned: 0 in 0.382s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6db07cc-5fea-426e-8af2-8f371beafde4 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:38 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6db07cc-5fea-426e-8af2-8f371beafde4 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e Jul 21 19:07:38 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:39 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6db07cc-5fea-426e-8af2-8f371beafde4 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e" returned: 0 in 0.299s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:39 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e is being set with open permissions: ugo+rw Jul 21 19:07:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:39 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e Jul 21 19:07:39 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:39 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e" returned: 0 in 0.273s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:39 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.info Jul 21 19:07:39 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:39 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.info" returned: 0 in 0.285s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:39 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.info is being set with open permissions: ugo+rw Jul 21 19:07:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:39 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.info Jul 21 19:07:39 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:40 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.info" returned: 0 in 0.283s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Acquiring lock "cinder-quobyte-114e12d5-343d-435d-baa2-5fa669b0652c" by "_copy_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Lock "cinder-quobyte-114e12d5-343d-435d-baa2-5fa669b0652c" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] snapshot: a137ee18-4815-4125-881e-0dfd859c330e, volume: 114e12d5-343d-435d-baa2-5fa669b0652c, {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Acquiring lock "cinder-9d1f2872-05af-41a3-89a1-0325d8c2cde1-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc31d686-f9dd-46cf-b114-4a44782e9ec8]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Lock "cinder-9d1f2872-05af-41a3-89a1-0325d8c2cde1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Acquiring lock "cinder-quobyte-9d1f2872-05af-41a3-89a1-0325d8c2cde1" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Lock "cinder-quobyte-9d1f2872-05af-41a3-89a1-0325d8c2cde1" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b16811-5e4d-480c-ac8a-35da89d482ad]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:40 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e Jul 21 19:07:40 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:40 devstack sudo[94214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1 Jul 21 19:07:40 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:40 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e" returned: 0 in 0.398s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6db07cc-5fea-426e-8af2-8f371beafde4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Creating direct copy from snapshot {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e59189-7e26-4a32-a1cc-87d6fc6b424a]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:40 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1" returned: 0 in 0.375s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:40 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1 Jul 21 19:07:40 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:40 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:40 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:40 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 Jul 21 19:07:40 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:40 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9d1f2872-05af-41a3-89a1-0325d8c2cde1" returned: 0 in 0.272s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Lock "cinder-quobyte-9d1f2872-05af-41a3-89a1-0325d8c2cde1" released by "delete_volume" :: held 0.705s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:40 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.290s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:07:40 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Created reservations ['2ac2cf08-4d52-4c71-b542-6cdcb128cb7c', '03921463-858c-4d8b-a340-390ce31af5bb', '6425e346-0599-4433-bac1-36b42d9100f1', '5d0bda89-c918-43e4-89e9-c62f501da68d'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:41 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4" returned: 0 in 0.495s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:41 devstack cinder-volume[87487]: DEBUG cinder.utils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Path /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c not found in is_blk_device check {{(pid=87487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:07:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:41 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c Jul 21 19:07:41 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:41 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:41 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:41 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.257s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:41 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:41 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Deleted volume successfully. Jul 21 19:07:41 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f6a83e4e-e742-4cf3-aa6b-b4aad7ff06d7 tempest-VolumeQuotasNegativeTestJSON-1990587130 None] Lock "cinder-9d1f2872-05af-41a3-89a1-0325d8c2cde1-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:45 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Flow 'volume_create_manager' (908df37c-246f-4f27-925c-a6bc0cb471af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3425d895-a221-4f28-a563-e50723dd517e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3425d895-a221-4f28-a563-e50723dd517e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1207754412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86a6dc3f65e4d43823677d07a6a90aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:46Z,use_quota=True,user_id='d2075424a3c647219a2480926a955dee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d701cb36-d94d-4543-821f-474c0143630c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d701cb36-d94d-4543-821f-474c0143630c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743396f5-d1cd-4b34-9dda-7127a3254023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743396f5-d1cd-4b34-9dda-7127a3254023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff', 'volume_name': 'volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb870db-051c-45c4-be94-bc082ac9ec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb870db-051c-45c4-be94-bc082ac9ec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eaa38d2-e817-4107-8ffe-f79528085e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:45 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Volume fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff', 'volume_size': 1} Jul 21 19:07:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:46 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c" returned: 0 in 5.447s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:46 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[051536da-e6f3-400e-8254-179e1a6359fe]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:46 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 Jul 21 19:07:46 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:47 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4" returned: 0 in 0.557s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:07:47 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Converted 1024.00 MB image at 187.95 MB/s Jul 21 19:07:47 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c is being set with open permissions: ugo+rw Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:47 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c Jul 21 19:07:47 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:47 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c" returned: 0 in 0.283s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Lock "cinder-quobyte-114e12d5-343d-435d-baa2-5fa669b0652c" released by "_copy_volume_from_snapshot" :: held 7.278s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Acquiring lock "cinder-quobyte-a137ee18-4815-4125-881e-0dfd859c330e" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Lock "cinder-quobyte-a137ee18-4815-4125-881e-0dfd859c330e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Deleting offline snapshot a137ee18-4815-4125-881e-0dfd859c330e of volume f6db07cc-5fea-426e-8af2-8f371beafde4 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] snapshot_file for this snap is: volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3fad28-2d6f-47e0-be7d-fb344ddb56d2]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:47 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e Jul 21 19:07:47 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:47 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e" returned: 0 in 0.380s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6db07cc-5fea-426e-8af2-8f371beafde4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c28a6c-8b21-4f27-b87d-defa81e13f75]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:47 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 Jul 21 19:07:47 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:48 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4" returned: 0 in 0.359s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:48 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e Jul 21 19:07:48 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:48 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e" returned: 0 in 0.340s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:48 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e Jul 21 19:07:48 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:48 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4.a137ee18-4815-4125-881e-0dfd859c330e" returned: 0 in 0.295s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Lock "cinder-quobyte-a137ee18-4815-4125-881e-0dfd859c330e" released by "_delete_snapshot" :: held 1.477s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.951s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.859s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-736480889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95af0bbd-b597-4219-bbd6-607d68fdd40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c310b2058b98480f90e7c8fbd91ed2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:38Z,use_quota=True,user_id='b977a7612ddc49d5b8dcc6d54df0ee6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Creating volume 95af0bbd-b597-4219-bbd6-607d68fdd40c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:48 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95af0bbd-b597-4219-bbd6-607d68fdd40c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:48 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95af0bbd-b597-4219-bbd6-607d68fdd40c 1073741824 Jul 21 19:07:48 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e78cf2-4ca4-497a-990d-d40c95b6b543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114e12d5-343d-435d-baa2-5fa669b0652c', 'volume_size': 2, 'source_volid': 'f6db07cc-5fea-426e-8af2-8f371beafde4', 'source_volstatus': 'available'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e570155-4604-4076-b71f-23f9f84e54af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:48 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Volume volume-114e12d5-343d-435d-baa2-5fa669b0652c (114e12d5-343d-435d-baa2-5fa669b0652c): created successfully Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e570155-4604-4076-b71f-23f9f84e54af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Flow 'volume_create_manager' (4efcd4fd-0068-4ad7-b787-023e991a4a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:49 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a0b0d5c2-014b-4a67-9e43-4cdc227bb0c6 tempest-VolumesCloneTest-1078396909 None] Created volume successfully. Jul 21 19:07:49 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95af0bbd-b597-4219-bbd6-607d68fdd40c 1073741824" returned: 0 in 0.544s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95af0bbd-b597-4219-bbd6-607d68fdd40c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:49 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95af0bbd-b597-4219-bbd6-607d68fdd40c Jul 21 19:07:49 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Acquiring lock "cinder-114e12d5-343d-435d-baa2-5fa669b0652c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Lock "cinder-114e12d5-343d-435d-baa2-5fa669b0652c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Acquiring lock "cinder-quobyte-114e12d5-343d-435d-baa2-5fa669b0652c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Lock "cinder-quobyte-114e12d5-343d-435d-baa2-5fa669b0652c" acquired by "delete_volume" :: waited 0.033s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e76a19-9227-4905-98b7-86d99d825aeb]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:49 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95af0bbd-b597-4219-bbd6-607d68fdd40c" returned: 0 in 0.325s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.851s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1207754412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86a6dc3f65e4d43823677d07a6a90aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:46Z,use_quota=True,user_id='d2075424a3c647219a2480926a955dee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Creating volume fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:49 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:49 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff 1073741824 Jul 21 19:07:49 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53845344-750d-4f63-aaf7-52dd02b6fe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95af0bbd-b597-4219-bbd6-607d68fdd40c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb196e9-afae-46bb-b9d2-a55a2a46855c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:49 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c Jul 21 19:07:49 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:49 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Volume volume-95af0bbd-b597-4219-bbd6-607d68fdd40c (95af0bbd-b597-4219-bbd6-607d68fdd40c): created successfully Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb196e9-afae-46bb-b9d2-a55a2a46855c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Flow 'volume_create_manager' (70e79e70-4956-40a1-aa75-745c6295ecfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:49 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-886ecf3f-8368-492d-aeac-4b33a961406c tempest-VolumesTransfersV357Test-827294800 None] Created volume successfully. Jul 21 19:07:50 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c" returned: 0 in 0.482s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:50 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c Jul 21 19:07:50 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:50 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff 1073741824" returned: 0 in 0.609s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:50 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff Jul 21 19:07:50 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:50 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-114e12d5-343d-435d-baa2-5fa669b0652c" returned: 0 in 0.304s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Lock "cinder-quobyte-114e12d5-343d-435d-baa2-5fa669b0652c" released by "delete_volume" :: held 0.848s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Created reservations ['161122a4-1255-40c7-b182-5fc828770b98', '1ef21097-cb32-44d6-9019-2f3a114f0e40', '96085d45-e951-45df-b952-c199f49664f0', 'd779849e-2c45-476a-9797-448c60d9bbe2'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:50 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff" returned: 0 in 0.321s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:50 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:50 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eaa38d2-e817-4107-8ffe-f79528085e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e2eb28-5196-434c-b36f-b38f4971821c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:50 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Volume volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff (fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff): created successfully Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e2eb28-5196-434c-b36f-b38f4971821c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Flow 'volume_create_manager' (908df37c-246f-4f27-925c-a6bc0cb471af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:50 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2da78fe3-ac1d-4b3a-96a0-5196fdd6c157 tempest-AttachVolumeTestJSON-624060388 None] Created volume successfully. Jul 21 19:07:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Acquiring lock "cinder-f6db07cc-5fea-426e-8af2-8f371beafde4-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Lock "cinder-f6db07cc-5fea-426e-8af2-8f371beafde4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Acquiring lock "cinder-quobyte-f6db07cc-5fea-426e-8af2-8f371beafde4" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Lock "cinder-quobyte-f6db07cc-5fea-426e-8af2-8f371beafde4" acquired by "delete_volume" :: waited 0.030s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:51 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.428s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:51 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:51 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6782b46-15b2-4c16-88ef-37ce1cd60512]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:51 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Deleted volume successfully. Jul 21 19:07:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd5cdbee-f97d-4c89-b006-c4b6f17d2637 tempest-VolumesCloneTest-1078396909 None] Lock "cinder-114e12d5-343d-435d-baa2-5fa669b0652c-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:51 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f0832ecf-c85f-4bd3-813e-d4722d4b5b58 tempest-VolumesTransfersV357Test-1438886479 None] Transfer volume completed successfully. Jul 21 19:07:51 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 Jul 21 19:07:51 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:51 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4" returned: 0 in 0.553s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:51 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4 Jul 21 19:07:51 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Acquiring lock "cinder-95af0bbd-b597-4219-bbd6-607d68fdd40c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:52 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f6db07cc-5fea-426e-8af2-8f371beafde4" returned: 0 in 0.392s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Lock "cinder-95af0bbd-b597-4219-bbd6-607d68fdd40c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Lock "cinder-quobyte-f6db07cc-5fea-426e-8af2-8f371beafde4" released by "delete_volume" :: held 1.072s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Acquiring lock "cinder-quobyte-95af0bbd-b597-4219-bbd6-607d68fdd40c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Lock "cinder-quobyte-95af0bbd-b597-4219-bbd6-607d68fdd40c" acquired by "delete_volume" :: waited 0.034s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Created reservations ['996af692-8882-4457-a439-a20bb2475bf0', '5f9ab362-fc88-49f1-8abb-5885fca54ae9', '56e5cc59-4d5f-4b49-bfbe-edcb83788a16', '4c4a1fd0-e7e5-4480-b10e-8794a763dee8'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d84094-5c5e-4d57-a170-15377ef2f20d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95af0bbd-b597-4219-bbd6-607d68fdd40c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:52 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95af0bbd-b597-4219-bbd6-607d68fdd40c Jul 21 19:07:52 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:52 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:52 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:52 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95af0bbd-b597-4219-bbd6-607d68fdd40c" returned: 0 in 0.499s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95af0bbd-b597-4219-bbd6-607d68fdd40c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:52 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.436s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:52 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95af0bbd-b597-4219-bbd6-607d68fdd40c Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:52 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:52 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Deleted volume successfully. Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-86aad8dc-1568-4dbc-8fb7-23fd0b94faa3 tempest-VolumesCloneTest-1078396909 None] Lock "cinder-f6db07cc-5fea-426e-8af2-8f371beafde4-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-e1ea6e63-c1b4-415c-a4f5-f04b9254fe6a req-eefb43e9-0f8b-497e-87ee-19e30c39653c tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-e1ea6e63-c1b4-415c-a4f5-f04b9254fe6a req-eefb43e9-0f8b-497e-87ee-19e30c39653c tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-e1ea6e63-c1b4-415c-a4f5-f04b9254fe6a req-eefb43e9-0f8b-497e-87ee-19e30c39653c tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-e1ea6e63-c1b4-415c-a4f5-f04b9254fe6a req-eefb43e9-0f8b-497e-87ee-19e30c39653c tempest-AttachVolumeTestJSON-624060388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a93690e6-09bb-4da2-9f46-a52c0425d094', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:07:53 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-e1ea6e63-c1b4-415c-a4f5-f04b9254fe6a req-eefb43e9-0f8b-497e-87ee-19e30c39653c tempest-AttachVolumeTestJSON-624060388 None] attachment_update completed successfully. Jul 21 19:07:53 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-95af0bbd-b597-4219-bbd6-607d68fdd40c" returned: 0 in 0.319s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Lock "cinder-quobyte-95af0bbd-b597-4219-bbd6-607d68fdd40c" released by "delete_volume" :: held 0.876s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:53 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Created reservations ['96ee57ec-dfc2-49c5-8c6c-e94639e26efa', 'b934d8be-12f7-4185-86d6-008b8e374660', '1e0feb15-5c95-484f-90ad-ab024c8b4fb3', 'ebaac53f-9369-4dc4-aff0-9c1895801631'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:53 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:53 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:53 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.404s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:53 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:53 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Deleted volume successfully. Jul 21 19:07:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6b166403-9d6d-43a4-836b-73b34a97a42d tempest-VolumesTransfersV357Test-912236257 None] Lock "cinder-95af0bbd-b597-4219-bbd6-607d68fdd40c-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Flow 'volume_create_manager' (8bb4cd88-adf2-4c38-936c-0c6d3cd4a002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2862c5fe-3f8f-43f6-9243-e4914da5fc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2862c5fe-3f8f-43f6-9243-e4914da5fc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-28646858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c310b2058b98480f90e7c8fbd91ed2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:54Z,use_quota=True,user_id='b977a7612ddc49d5b8dcc6d54df0ee6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e2d748-8f76-44d1-b537-b30ec7b7cb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e2d748-8f76-44d1-b537-b30ec7b7cb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cfbc8c-daa9-4643-849b-a51ab0b14f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cfbc8c-daa9-4643-849b-a51ab0b14f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53', 'volume_name': 'volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051075d4-ed1c-45d3-9c71-fd2feffdd931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051075d4-ed1c-45d3-9c71-fd2feffdd931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388b01b9-3121-4c7f-b0c6-aa058763bc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:54 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Volume 4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53', 'volume_size': 1} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-28646858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c310b2058b98480f90e7c8fbd91ed2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:54Z,use_quota=True,user_id='b977a7612ddc49d5b8dcc6d54df0ee6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Creating volume 4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:54 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:54 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53 1073741824 Jul 21 19:07:54 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:54 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53 1073741824" returned: 0 in 0.558s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:55 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53 Jul 21 19:07:55 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:55 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53" returned: 0 in 0.494s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388b01b9-3121-4c7f-b0c6-aa058763bc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aba9f38-b0b5-4a82-b9f1-65c790dff37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:55 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Volume volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53 (4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53): created successfully Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aba9f38-b0b5-4a82-b9f1-65c790dff37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Flow 'volume_create_manager' (8bb4cd88-adf2-4c38-936c-0c6d3cd4a002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:55 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-57c9b435-6424-493a-bfd2-5171cfb5e06e tempest-VolumesTransfersV357Test-827294800 None] Created volume successfully. Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Flow 'volume_create_manager' (ac60a990-ae30-4ee7-843f-41ad746ee7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7d2bb5-d7c5-479c-87dd-b602c0f40da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7d2bb5-d7c5-479c-87dd-b602c0f40da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1449905386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d58ff1-3c6d-4e2c-8530-3ccd130da024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d950563d697459fb582d4b008c2309a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:56Z,use_quota=True,user_id='e43c8b2a28bc4f959422fa561239921b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a765d6-4335-4e28-8297-08cd945f571a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a765d6-4335-4e28-8297-08cd945f571a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe83d1f8-c004-4d3a-a3a7-3212f4e1f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe83d1f8-c004-4d3a-a3a7-3212f4e1f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9d58ff1-3c6d-4e2c-8530-3ccd130da024', 'volume_name': 'volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e52c3d-8fa4-41bb-a4ec-2225a4f13b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e52c3d-8fa4-41bb-a4ec-2225a4f13b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebf8507-7c47-45eb-85a3-5ff8f8275477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:55 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Volume c9d58ff1-3c6d-4e2c-8530-3ccd130da024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024', 'volume_size': 1} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1449905386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d58ff1-3c6d-4e2c-8530-3ccd130da024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d950563d697459fb582d4b008c2309a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:56Z,use_quota=True,user_id='e43c8b2a28bc4f959422fa561239921b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Creating volume c9d58ff1-3c6d-4e2c-8530-3ccd130da024 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:55 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:56 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 1073741824 Jul 21 19:07:56 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:56 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 1073741824" returned: 0 in 0.547s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Acquiring lock "cinder-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:56 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 Jul 21 19:07:56 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Lock "cinder-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Acquiring lock "cinder-quobyte-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Lock "cinder-quobyte-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bffb04d-1e99-4e3e-b4ff-065adb645cda]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:56 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53 Jul 21 19:07:56 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:56 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" returned: 0 in 0.332s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebf8507-7c47-45eb-85a3-5ff8f8275477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763ca637-2342-40bc-96af-146b5cb3b116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:56 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Volume volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 (c9d58ff1-3c6d-4e2c-8530-3ccd130da024): created successfully Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763ca637-2342-40bc-96af-146b5cb3b116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Flow 'volume_create_manager' (ac60a990-ae30-4ee7-843f-41ad746ee7d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:56 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-26d26ca9-6d0c-4c1a-a98d-6b4de4f0f922 tempest-VolumesDeleteCascade-340170452 None] Created volume successfully. Jul 21 19:07:57 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53" returned: 0 in 0.469s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:57 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53 Jul 21 19:07:57 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Flow 'volume_create_manager' (2cedae0d-09ee-4765-ac2e-73679f6d9ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:57 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48879eb4-069e-44c4-91e5-e2d50d91e4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53" returned: 0 in 0.318s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48879eb4-069e-44c4-91e5-e2d50d91e4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-389871290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5cccc7c-c2c1-41a2-a81a-82289d36c80b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b4ee738aed46ffbdd4a06bb252ad62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:57Z,use_quota=True,user_id='deaa554c230d4420bee6d5770587eeb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc757d7-5600-443f-9849-29ad62dbb569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc757d7-5600-443f-9849-29ad62dbb569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efc717f-cddf-4a33-ba0c-91652b0cb999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efc717f-cddf-4a33-ba0c-91652b0cb999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5cccc7c-c2c1-41a2-a81a-82289d36c80b', 'volume_name': 'volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20f5065-f1d3-4c69-b4a5-c738f5ed82b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20f5065-f1d3-4c69-b4a5-c738f5ed82b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002882e9-1eb4-4c45-a7dc-c3e885db1e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:57 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Volume a5cccc7c-c2c1-41a2-a81a-82289d36c80b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b', 'volume_size': 1} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-389871290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5cccc7c-c2c1-41a2-a81a-82289d36c80b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b4ee738aed46ffbdd4a06bb252ad62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:57Z,use_quota=True,user_id='deaa554c230d4420bee6d5770587eeb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Creating volume a5cccc7c-c2c1-41a2-a81a-82289d36c80b {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:57 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Lock "cinder-quobyte-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53" released by "delete_volume" :: held 0.928s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:57 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b 1073741824 Jul 21 19:07:57 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Created reservations ['b9efb36f-54f0-455d-a7ba-59c6feef40d8', 'dbe4bf2e-c26b-4d86-8bd0-602a2adf164f', '955e6bc9-9d04-4839-8119-2cc95beb63a9', 'e457f2e3-dede-4682-b7a5-723eb71f7af4'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:57 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:07:57 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:58 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.395s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:58 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Deleted volume successfully. Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ba486eef-f183-4530-b177-3ccf0576a431 tempest-VolumesTransfersV357Test-912236257 None] Lock "cinder-4c1cae7e-a8c9-4e47-ac23-2b2a8e2d4b53-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:58 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b 1073741824" returned: 0 in 0.828s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:58 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b Jul 21 19:07:58 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:58 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" returned: 0 in 0.355s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.416s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002882e9-1eb4-4c45-a7dc-c3e885db1e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055f307e-bf0f-4830-a8ba-8bc28fbbfaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] Creating offline snapshot 6aef66b4-a3b7-4561-8e95-53610b22ed8c of volume c9d58ff1-3c6d-4e2c-8530-3ccd130da024 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27d624f-6398-453d-a599-e53988dabd2b]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:58 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Volume volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b (a5cccc7c-c2c1-41a2-a81a-82289d36c80b): created successfully Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055f307e-bf0f-4830-a8ba-8bc28fbbfaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Flow 'volume_create_manager' (2cedae0d-09ee-4765-ac2e-73679f6d9ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:59 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f7ad9064-2494-48ef-a60b-50364b6d12fd tempest-VolumesSnapshotListTestJSON-1390847505 None] Created volume successfully. Jul 21 19:07:59 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 Jul 21 19:07:59 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:59 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" returned: 0 in 0.403s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:59 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c 1G Jul 21 19:07:59 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:00 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c 1G" returned: 0 in 0.864s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:00 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c Jul 21 19:08:00 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:00 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c" returned: 0 in 0.731s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:00 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c is being set with open permissions: ugo+rw Jul 21 19:08:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:01 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c Jul 21 19:08:01 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:01 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c" returned: 0 in 0.393s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:01 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.info Jul 21 19:08:01 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:01 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.info" returned: 0 in 0.410s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:01 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.info is being set with open permissions: ugo+rw Jul 21 19:08:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:01 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.info Jul 21 19:08:01 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:02 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.info" returned: 0 in 0.321s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.267s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.048s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] Creating offline snapshot 11a6a258-e8ca-4fa4-aa34-89163c633c44 of volume a5cccc7c-c2c1-41a2-a81a-82289d36c80b {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:08:02 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-02ea10f2-89d3-4adc-9fc7-84c5e2e4ed6c tempest-VolumesDeleteCascade-340170452 None] Create snapshot completed successfully Jul 21 19:08:02 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[df184a13-dfe1-4249-88db-226100a72825]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:02 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b Jul 21 19:08:02 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:02 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" returned: 0 in 0.441s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:02 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 1G Jul 21 19:08:02 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:03 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 1G" returned: 0 in 0.775s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:03 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 Jul 21 19:08:03 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:03 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44" returned: 0 in 0.352s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:03 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 is being set with open permissions: ugo+rw Jul 21 19:08:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:03 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 Jul 21 19:08:03 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:04 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44" returned: 0 in 0.278s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:04 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.info Jul 21 19:08:04 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:04 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.info" returned: 0 in 0.316s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:04 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.info is being set with open permissions: ugo+rw Jul 21 19:08:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:04 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.info Jul 21 19:08:04 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:04 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.info" returned: 0 in 0.265s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.565s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.552s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] Creating offline snapshot b7cd4553-982c-4432-83b6-efeb9857835c of volume c9d58ff1-3c6d-4e2c-8530-3ccd130da024 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:08:04 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f435fb-3736-4d6a-a79e-3a28568873d7]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:04 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-38215837-56af-4ab4-bcd4-26d9d0b43b15 tempest-VolumesSnapshotListTestJSON-1390847505 None] Create snapshot completed successfully Jul 21 19:08:04 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c Jul 21 19:08:04 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:05 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c" returned: 0 in 0.447s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:05 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c 1G Jul 21 19:08:05 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:05 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c 1G" returned: 0 in 0.561s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:05 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c Jul 21 19:08:05 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:06 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c" returned: 0 in 0.326s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:06 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c is being set with open permissions: ugo+rw Jul 21 19:08:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:06 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c Jul 21 19:08:06 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:06 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c" returned: 0 in 0.274s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:06 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:UPDATE=174,cinder:SELECT=120,cinder:INSERT=41,cinder:DELETE=14 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:08:06 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=140,cinder:INSERT=41,cinder:UPDATE=171,cinder:DELETE=17 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:08:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.743s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.866s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] Creating offline snapshot fd21494a-ad2b-40a5-96f4-39f2f168d080 of volume a5cccc7c-c2c1-41a2-a81a-82289d36c80b {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:08:06 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-01f00afc-6fdc-4d6f-a34b-3bb94b7b85de tempest-VolumesDeleteCascade-340170452 None] Create snapshot completed successfully Jul 21 19:08:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1aad14-2163-4e6d-8888-6bcfc5e56362]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:06 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 Jul 21 19:08:06 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:06 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44" returned: 0 in 0.396s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:07 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 1G Jul 21 19:08:07 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-c9d58ff1-3c6d-4e2c-8530-3ccd130da024-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-c9d58ff1-3c6d-4e2c-8530-3ccd130da024-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Performing cascade delete. {{(pid=87487) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 21 19:08:07 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 1G" returned: 0 in 0.586s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-6aef66b4-a3b7-4561-8e95-53610b22ed8c-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:07 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 Jul 21 19:08:07 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-6aef66b4-a3b7-4561-8e95-53610b22ed8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-quobyte-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-quobyte-6aef66b4-a3b7-4561-8e95-53610b22ed8c" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-6aef66b4-a3b7-4561-8e95-53610b22ed8c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Deleting offline snapshot 6aef66b4-a3b7-4561-8e95-53610b22ed8c of volume c9d58ff1-3c6d-4e2c-8530-3ccd130da024 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] snapshot_file for this snap is: volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ed1bb4-c719-4a27-9763-47f46db0bef8]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:07 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c Jul 21 19:08:07 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:07 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080" returned: 0 in 0.387s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:07 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 is being set with open permissions: ugo+rw Jul 21 19:08:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:07 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 Jul 21 19:08:07 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:08 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080" returned: 0 in 0.347s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:08 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.876s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c" returned: 0 in 0.623s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:08 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:08 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ace201-3b75-4c0f-98fd-0fe97f7a964c]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:08 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c89dfb89-25c8-44fd-9735-87ec21b6e07b tempest-VolumesSnapshotListTestJSON-1390847505 None] Create snapshot completed successfully Jul 21 19:08:08 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 Jul 21 19:08:08 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:08 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" returned: 0 in 0.459s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:08 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[094256b2-5aa7-4e74-b73c-8d7201dfcbe4]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] Creating offline snapshot 1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 of volume a5cccc7c-c2c1-41a2-a81a-82289d36c80b {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:08:09 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c Jul 21 19:08:09 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f594a7f4-e838-4e6d-b457-628e6347b4d2]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:09 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 Jul 21 19:08:09 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:09 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c" returned: 0 in 0.545s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[549baf65-b525-495f-8710-72d1c060b3ea]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:09 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c Jul 21 19:08:09 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:09 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080" returned: 0 in 0.497s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:09 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 1G Jul 21 19:08:09 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:09 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c" returned: 0 in 0.468s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b78042-dd71-4e6a-8808-e339f1f437e2]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:10 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 Jul 21 19:08:10 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:10 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" returned: 0 in 0.473s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:10 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 1G" returned: 0 in 0.821s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:10 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c Jul 21 19:08:10 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:10 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 Jul 21 19:08:10 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:10 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01" returned: 0 in 0.353s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:10 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 is being set with open permissions: ugo+rw Jul 21 19:08:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:10 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 Jul 21 19:08:10 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:10 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c" returned: 0 in 0.483s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:10 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c Jul 21 19:08:10 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:11 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01" returned: 0 in 0.334s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:11 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-8f7b8430-bbba-45ce-93b8-0bf6a6031657 tempest-VolumesSnapshotListTestJSON-1390847505 None] Create snapshot completed successfully Jul 21 19:08:11 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.6aef66b4-a3b7-4561-8e95-53610b22ed8c" returned: 0 in 0.341s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c -F qcow2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:11 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c -F qcow2 Jul 21 19:08:11 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:11 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c -F qcow2" returned: 0 in 0.309s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-6aef66b4-a3b7-4561-8e95-53610b22ed8c" released by "_delete_snapshot" :: held 3.940s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" released by "delete_snapshot" :: held 3.977s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Created reservations ['b9237004-b377-4662-bbd5-c7b063716d3c', '2dd57b5f-1037-44f6-8570-7c05ca985944', '0cfbbe01-0a51-42b8-a8d2-3fc22696d603', 'a0ed82d7-0486-4b74-ac4f-5573380b0591'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:11 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Delete snapshot completed successfully. Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-6aef66b4-a3b7-4561-8e95-53610b22ed8c-delete_snapshot" released by "delete_snapshot" :: held 4.174s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-b7cd4553-982c-4432-83b6-efeb9857835c-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-b7cd4553-982c-4432-83b6-efeb9857835c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-quobyte-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-quobyte-b7cd4553-982c-4432-83b6-efeb9857835c" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-b7cd4553-982c-4432-83b6-efeb9857835c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Deleting offline snapshot b7cd4553-982c-4432-83b6-efeb9857835c of volume c9d58ff1-3c6d-4e2c-8530-3ccd130da024 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] snapshot_file for this snap is: volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa105600-21cd-4f97-b6ac-9e913bd911c0]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:11 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c Jul 21 19:08:11 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:12 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c" returned: 0 in 0.463s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:12 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a81e57c-656a-4a67-bdf0-579f84bc8acf]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:12 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 Jul 21 19:08:12 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:12 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" returned: 0 in 0.509s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:12 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c Jul 21 19:08:12 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:13 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c" returned: 0 in 0.542s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "cinder-1749ee13-827c-4ba5-b8e2-1da2ae5b4b01-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-1749ee13-827c-4ba5-b8e2-1da2ae5b4b01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "cinder-quobyte-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:13 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c Jul 21 19:08:13 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-quobyte-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "cinder-quobyte-1749ee13-827c-4ba5-b8e2-1da2ae5b4b01" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-quobyte-1749ee13-827c-4ba5-b8e2-1da2ae5b4b01" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Deleting offline snapshot 1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 of volume a5cccc7c-c2c1-41a2-a81a-82289d36c80b {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] snapshot_file for this snap is: volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca65383-0337-486b-ba4f-843fc5544e32]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:13 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 Jul 21 19:08:13 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:13 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024.b7cd4553-982c-4432-83b6-efeb9857835c" returned: 0 in 0.347s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-b7cd4553-982c-4432-83b6-efeb9857835c" released by "_delete_snapshot" :: held 1.978s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" released by "delete_snapshot" :: held 2.002s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Created reservations ['f97033d4-a4c4-4561-9cb3-1804d5d147c9', '739cf8e6-3796-4050-835d-7137d7c1905e', 'b74365c8-3980-4b0f-b1a3-8d090a4419e9', '8174ffe7-6195-41dc-8ce9-264a186ebf58'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:13 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Delete snapshot completed successfully. Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-b7cd4553-982c-4432-83b6-efeb9857835c-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Snapshots deleted, issuing volume delete {{(pid=87487) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 21 19:08:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-quobyte-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:14 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91ce18f-b906-4009-9d15-99dfd8b784df]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:14 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01" returned: 0 in 0.528s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:14 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[77188559-71a8-4eb7-afcb-c3bae31c31b5]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:14 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 Jul 21 19:08:14 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:14 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 Jul 21 19:08:14 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:14 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080" returned: 0 in 0.549s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:14 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 Jul 21 19:08:14 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:14 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" returned: 0 in 0.708s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:14 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024 Jul 21 19:08:14 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:15 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" returned: 0 in 0.430s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-c9d58ff1-3c6d-4e2c-8530-3ccd130da024" released by "delete_volume" :: held 1.208s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Created reservations ['001e5e03-5fcb-405d-9b76-d427f518a254', '3889b849-b2b3-4ea5-9221-85baa688dcdc', '46fd1b2f-b8e0-44d9-a5a2-b4ef28857ab9', 'e6443f23-0910-4f75-bf88-2706e1a28ae0'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:15 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01" returned: 0 in 0.656s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:15 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:08:15 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:15 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01 Jul 21 19:08:15 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:15 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:15 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.1749ee13-827c-4ba5-b8e2-1da2ae5b4b01" returned: 0 in 0.268s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.316s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-quobyte-1749ee13-827c-4ba5-b8e2-1da2ae5b4b01" released by "_delete_snapshot" :: held 2.136s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:15 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Deleted volume successfully. Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-quobyte-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" released by "delete_snapshot" :: held 2.179s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e881784a-003e-4b9e-9150-a96818159714 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-c9d58ff1-3c6d-4e2c-8530-3ccd130da024-delete_volume" released by "delete_volume" :: held 8.246s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Created reservations ['4c189700-66c9-4122-8c70-8e9c1a3ab8a9', '27776b36-c3f6-429a-beee-b9bbc8dfc053', 'd6738856-c352-433c-91f6-8907e55041f6', '3b33b8ed-8545-413b-926b-75d33edfe305'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:15 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Delete snapshot completed successfully. Jul 21 19:08:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b93338f0-c082-42d0-a33d-c5ccdcf67fe7 tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-1749ee13-827c-4ba5-b8e2-1da2ae5b4b01-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "cinder-fd21494a-ad2b-40a5-96f4-39f2f168d080-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-fd21494a-ad2b-40a5-96f4-39f2f168d080-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "cinder-quobyte-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-quobyte-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "cinder-quobyte-fd21494a-ad2b-40a5-96f4-39f2f168d080" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-quobyte-fd21494a-ad2b-40a5-96f4-39f2f168d080" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Deleting offline snapshot fd21494a-ad2b-40a5-96f4-39f2f168d080 of volume a5cccc7c-c2c1-41a2-a81a-82289d36c80b {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:08:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] snapshot_file for this snap is: volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:08:16 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1d07b9-af9b-43e4-ba70-49ea5627a3c5]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:17 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 Jul 21 19:08:17 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Flow 'volume_create_manager' (7f5fb016-9ef3-41ca-a7ec-b4598bbaaa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555063e4-6947-4db9-bd36-f821e3da57a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555063e4-6947-4db9-bd36-f821e3da57a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1006415495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1d494d-2a7d-4c62-966c-0d33156c833c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d950563d697459fb582d4b008c2309a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:17Z,use_quota=True,user_id='e43c8b2a28bc4f959422fa561239921b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8eab920-ec73-4879-b95d-81d4c0d979eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8eab920-ec73-4879-b95d-81d4c0d979eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60b861f-c998-4b9d-af04-8bc1dd42de5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60b861f-c998-4b9d-af04-8bc1dd42de5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e1d494d-2a7d-4c62-966c-0d33156c833c', 'volume_name': 'volume-0e1d494d-2a7d-4c62-966c-0d33156c833c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609ef1ef-51c0-493e-b677-6047b6859558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609ef1ef-51c0-493e-b677-6047b6859558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b813fc-97c3-4d85-8a48-69ef1153c551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:17 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Volume 0e1d494d-2a7d-4c62-966c-0d33156c833c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e1d494d-2a7d-4c62-966c-0d33156c833c', 'volume_size': 1} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1006415495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1d494d-2a7d-4c62-966c-0d33156c833c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d950563d697459fb582d4b008c2309a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:17Z,use_quota=True,user_id='e43c8b2a28bc4f959422fa561239921b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Creating volume 0e1d494d-2a7d-4c62-966c-0d33156c833c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:17 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:17 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c 1073741824 Jul 21 19:08:17 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:17 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080" returned: 0 in 0.456s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[605b3f54-e958-4ecc-9eac-de0c9bcd4119]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:17 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 Jul 21 19:08:17 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:17 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c 1073741824" returned: 0 in 0.547s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:17 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c Jul 21 19:08:17 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:17 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44" returned: 0 in 0.435s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:17 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 Jul 21 19:08:17 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:18 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c" returned: 0 in 0.289s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b813fc-97c3-4d85-8a48-69ef1153c551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e1d494d-2a7d-4c62-966c-0d33156c833c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cb5286-bdd1-4cff-b24e-266ef6cb7da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:18 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Volume volume-0e1d494d-2a7d-4c62-966c-0d33156c833c (0e1d494d-2a7d-4c62-966c-0d33156c833c): created successfully Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cb5286-bdd1-4cff-b24e-266ef6cb7da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Flow 'volume_create_manager' (7f5fb016-9ef3-41ca-a7ec-b4598bbaaa89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:18 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a0842a4a-b551-4236-85fb-7f2817e70049 tempest-VolumesDeleteCascade-340170452 None] Created volume successfully. Jul 21 19:08:18 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080" returned: 0 in 0.429s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:18 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080 Jul 21 19:08:18 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:18 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.fd21494a-ad2b-40a5-96f4-39f2f168d080" returned: 0 in 0.241s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-quobyte-fd21494a-ad2b-40a5-96f4-39f2f168d080" released by "_delete_snapshot" :: held 1.686s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-quobyte-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" released by "delete_snapshot" :: held 1.718s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Created reservations ['8fb2aa38-7b28-4e77-955d-bd22b889ccd4', '48329ec5-fe73-4f2b-b72c-37bfba788995', '628522b0-cfce-4057-a6af-0a976ec19de9', 'b94db8c5-e366-444a-a66a-cd4003dd331f'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:18 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Delete snapshot completed successfully. Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-69a1bb6e-689f-4747-b451-26519355f57b tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-fd21494a-ad2b-40a5-96f4-39f2f168d080-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "cinder-11a6a258-e8ca-4fa4-aa34-89163c633c44-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-11a6a258-e8ca-4fa4-aa34-89163c633c44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "cinder-quobyte-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-quobyte-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "cinder-quobyte-11a6a258-e8ca-4fa4-aa34-89163c633c44" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-quobyte-11a6a258-e8ca-4fa4-aa34-89163c633c44" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Deleting offline snapshot 11a6a258-e8ca-4fa4-aa34-89163c633c44 of volume a5cccc7c-c2c1-41a2-a81a-82289d36c80b {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] snapshot_file for this snap is: volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5543c4-ac28-4b98-ac14-df3f93610803]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:19 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 Jul 21 19:08:19 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] Creating offline snapshot f0e71098-8f1e-4b96-a587-3e74f9f7c573 of volume 0e1d494d-2a7d-4c62-966c-0d33156c833c {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[47128111-755d-41b4-b931-d35ae357a750]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:19 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c Jul 21 19:08:19 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:19 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44" returned: 0 in 0.464s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ca1285-6351-45b7-8d6d-bf826d87ac66]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:19 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b Jul 21 19:08:19 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:19 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c" returned: 0 in 0.401s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:19 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 1G Jul 21 19:08:19 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:19 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" returned: 0 in 0.395s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:19 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 Jul 21 19:08:19 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:20 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 1G" returned: 0 in 0.482s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e1d494d-2a7d-4c62-966c-0d33156c833c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:20 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e1d494d-2a7d-4c62-966c-0d33156c833c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 Jul 21 19:08:20 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:20 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44" returned: 0 in 0.428s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:20 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44 Jul 21 19:08:20 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:20 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e1d494d-2a7d-4c62-966c-0d33156c833c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573" returned: 0 in 0.405s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:20 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 is being set with open permissions: ugo+rw Jul 21 19:08:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:20 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 Jul 21 19:08:20 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:20 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b.11a6a258-e8ca-4fa4-aa34-89163c633c44" returned: 0 in 0.352s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-quobyte-11a6a258-e8ca-4fa4-aa34-89163c633c44" released by "_delete_snapshot" :: held 1.767s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-quobyte-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" released by "delete_snapshot" :: held 1.797s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:20 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Created reservations ['18250eff-ed4a-4ab9-90b9-ae403fdb6c37', '626d6e79-831b-4e61-b6cc-b68f49c8ef25', '394b999d-5045-44fe-b908-4aa150680965', '83a8baa1-6d52-40da-aa6f-f40c0f6bdc75'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:20 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Delete snapshot completed successfully. Jul 21 19:08:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-af5f8337-7111-4e30-9a15-21710ebfa11a tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-11a6a258-e8ca-4fa4-aa34-89163c633c44-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:20 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573" returned: 0 in 0.292s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:21 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.info Jul 21 19:08:21 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "cinder-a5cccc7c-c2c1-41a2-a81a-82289d36c80b-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-a5cccc7c-c2c1-41a2-a81a-82289d36c80b-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "cinder-quobyte-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-quobyte-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:21 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.info" returned: 0 in 0.543s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:21 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.info is being set with open permissions: ugo+rw Jul 21 19:08:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:21 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b53a6a7-6858-4bbe-bacc-2e7ddce8edcb]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:21 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.info Jul 21 19:08:21 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:21 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b Jul 21 19:08:21 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:21 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.info" returned: 0 in 0.367s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.596s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:21 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-090aabfd-2115-4bd1-921a-d470f79dc55e tempest-VolumesDeleteCascade-340170452 None] Create snapshot completed successfully Jul 21 19:08:22 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" returned: 0 in 0.481s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:22 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b Jul 21 19:08:22 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:22 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" returned: 0 in 0.340s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-quobyte-a5cccc7c-c2c1-41a2-a81a-82289d36c80b" released by "delete_volume" :: held 0.946s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:22 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Created reservations ['f41463a5-e86c-4ece-ab2d-60a7aef25f8d', '6239d7dc-5523-4e1d-9a8a-5cafe3dcc2e7', '8212ca8e-6dff-4af1-a107-b7c491af925e', 'da254ad0-40f6-46f5-a2a1-914e93afebc2'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:22 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:08:22 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:23 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.421s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:23 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Deleted volume successfully. Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd2f1100-2ed4-43f4-a214-c2e7848ff70a tempest-VolumesSnapshotListTestJSON-1390847505 None] Lock "cinder-a5cccc7c-c2c1-41a2-a81a-82289d36c80b-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Flow 'volume_create_manager' (e30d5df5-2708-4288-9116-bf8564831eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec827c9b-22fe-48e2-a65e-a9d4af3c8ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec827c9b-22fe-48e2-a65e-a9d4af3c8ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-663662665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9640ef8c-7932-422b-a8da-015c7d549048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d950563d697459fb582d4b008c2309a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0e71098-8f1e-4b96-a587-3e74f9f7c573,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:23Z,use_quota=True,user_id='e43c8b2a28bc4f959422fa561239921b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47db3893-adb8-49d9-a06e-1a3981943bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47db3893-adb8-49d9-a06e-1a3981943bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c921c3-8c0e-400a-af2d-d28f518a2907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c921c3-8c0e-400a-af2d-d28f518a2907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9640ef8c-7932-422b-a8da-015c7d549048', 'volume_name': 'volume-9640ef8c-7932-422b-a8da-015c7d549048', 'volume_size': 1, 'snapshot_id': 'f0e71098-8f1e-4b96-a587-3e74f9f7c573'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d29b2d-73fd-4913-bf76-c4f8bbb81292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d29b2d-73fd-4913-bf76-c4f8bbb81292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b5ac5b-f717-4f01-8088-e25564288e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:23 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Volume 9640ef8c-7932-422b-a8da-015c7d549048: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9640ef8c-7932-422b-a8da-015c7d549048', 'volume_size': 1, 'snapshot_id': 'f0e71098-8f1e-4b96-a587-3e74f9f7c573'} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-quobyte-f0e71098-8f1e-4b96-a587-3e74f9f7c573-9640ef8c-7932-422b-a8da-015c7d549048" by "_create_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-f0e71098-8f1e-4b96-a587-3e74f9f7c573-9640ef8c-7932-422b-a8da-015c7d549048" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Creating volume 9640ef8c-7932-422b-a8da-015c7d549048 from snapshot f0e71098-8f1e-4b96-a587-3e74f9f7c573 {{(pid=87487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-quobyte-9640ef8c-7932-422b-a8da-015c7d549048" by "_copy_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-9640ef8c-7932-422b-a8da-015c7d549048" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] snapshot: f0e71098-8f1e-4b96-a587-3e74f9f7c573, volume: 9640ef8c-7932-422b-a8da-015c7d549048, {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[19210889-4d0f-4a51-b821-604059214f44]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:23 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 Jul 21 19:08:23 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:23 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-586fc903-0f8f-44d3-bdf8-27c386bbf6ee req-3ea49091-dc08-4fc4-96df-6c9e75a676a6 tempest-AttachVolumeTestJSON-624060388 None] Terminate volume connection completed successfully. Jul 21 19:08:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-586fc903-0f8f-44d3-bdf8-27c386bbf6ee req-3ea49091-dc08-4fc4-96df-6c9e75a676a6 tempest-AttachVolumeTestJSON-624060388 None] Deleting attachment a93690e6-09bb-4da2-9f46-a52c0425d094. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:08:24 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573" returned: 0 in 0.570s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e1d494d-2a7d-4c62-966c-0d33156c833c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:08:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Creating direct copy from snapshot {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:08:24 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f459f47d-24ea-4093-92ad-061ca75a5ac4]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:24 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c Jul 21 19:08:24 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:24 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c" returned: 0 in 0.511s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:24 devstack cinder-volume[87487]: DEBUG cinder.utils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Path /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048 not found in is_blk_device check {{(pid=87487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:08:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:24 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048 Jul 21 19:08:24 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:31 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048" returned: 0 in 6.332s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9160150-7e60-4590-ae13-675bdab56891]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:31 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c Jul 21 19:08:31 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Flow 'volume_create_manager' (e1975ce0-7c43-49fe-a9ec-5b95c6e96f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296e4547-85c4-44ae-ab97-7111f2d8341f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296e4547-85c4-44ae-ab97-7111f2d8341f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1836197679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6372a3b-3323-44be-a708-710a2b9b2548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6b15dbc631400cbfb085277384dc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:31Z,use_quota=True,user_id='23cdf746123944abba2a77fad0357763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a229240-ebfc-4e3f-ac82-b8951a61b76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a229240-ebfc-4e3f-ac82-b8951a61b76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a72bc5-772a-418c-a7c1-71f6e833ce07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a72bc5-772a-418c-a7c1-71f6e833ce07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6372a3b-3323-44be-a708-710a2b9b2548', 'volume_name': 'volume-e6372a3b-3323-44be-a708-710a2b9b2548', 'volume_size': 2}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f2b310-b975-41c6-ab6b-0eb282993d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f2b310-b975-41c6-ab6b-0eb282993d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e7d54a-84a4-412b-9928-195445399f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:31 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Volume e6372a3b-3323-44be-a708-710a2b9b2548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6372a3b-3323-44be-a708-710a2b9b2548', 'volume_size': 2} Jul 21 19:08:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:32 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c" returned: 0 in 0.844s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:08:32 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Converted 1024.00 MB image at 161.67 MB/s Jul 21 19:08:32 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048 is being set with open permissions: ugo+rw Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:32 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048 Jul 21 19:08:32 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:32 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048" returned: 0 in 0.391s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-9640ef8c-7932-422b-a8da-015c7d549048" released by "_copy_volume_from_snapshot" :: held 8.804s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-f0e71098-8f1e-4b96-a587-3e74f9f7c573-9640ef8c-7932-422b-a8da-015c7d549048" released by "_create_volume_from_snapshot" :: held 8.864s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.894s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.854s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1836197679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6372a3b-3323-44be-a708-710a2b9b2548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6b15dbc631400cbfb085277384dc57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:31Z,use_quota=True,user_id='23cdf746123944abba2a77fad0357763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Creating volume e6372a3b-3323-44be-a708-710a2b9b2548 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:32 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548 2147483648 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:32 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548 2147483648 Jul 21 19:08:32 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b5ac5b-f717-4f01-8088-e25564288e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9640ef8c-7932-422b-a8da-015c7d549048', 'volume_size': 1, 'snapshot_id': 'f0e71098-8f1e-4b96-a587-3e74f9f7c573'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34dd6df-d2df-4c49-9f9d-bb0ff5a090f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:32 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Volume volume-9640ef8c-7932-422b-a8da-015c7d549048 (9640ef8c-7932-422b-a8da-015c7d549048): created successfully Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34dd6df-d2df-4c49-9f9d-bb0ff5a090f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Flow 'volume_create_manager' (e30d5df5-2708-4288-9116-bf8564831eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:32 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-fc9eb1f0-f21a-4de4-95bd-2fd82e36db54 tempest-VolumesDeleteCascade-340170452 None] Created volume successfully. Jul 21 19:08:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-0e1d494d-2a7d-4c62-966c-0d33156c833c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-0e1d494d-2a7d-4c62-966c-0d33156c833c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Performing cascade delete. {{(pid=87487) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 21 19:08:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-f0e71098-8f1e-4b96-a587-3e74f9f7c573-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-f0e71098-8f1e-4b96-a587-3e74f9f7c573-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-quobyte-0e1d494d-2a7d-4c62-966c-0d33156c833c" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-0e1d494d-2a7d-4c62-966c-0d33156c833c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-quobyte-f0e71098-8f1e-4b96-a587-3e74f9f7c573" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-f0e71098-8f1e-4b96-a587-3e74f9f7c573" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Deleting offline snapshot f0e71098-8f1e-4b96-a587-3e74f9f7c573 of volume 0e1d494d-2a7d-4c62-966c-0d33156c833c {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:08:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] snapshot_file for this snap is: volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:08:33 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[28490b2f-3807-4663-a47f-be85c2f39134]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:33 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 Jul 21 19:08:33 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:33 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548 2147483648" returned: 0 in 1.021s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:33 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548 Jul 21 19:08:33 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:33 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573" returned: 0 in 0.709s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e1d494d-2a7d-4c62-966c-0d33156c833c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:34 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b785c5-f94a-4308-a682-7b816eb069b0]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:34 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548" returned: 0 in 0.492s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e7d54a-84a4-412b-9928-195445399f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6372a3b-3323-44be-a708-710a2b9b2548', 'volume_size': 2}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20e82cd-ac09-4f6c-b69d-189711ea9336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:34 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Volume volume-e6372a3b-3323-44be-a708-710a2b9b2548 (e6372a3b-3323-44be-a708-710a2b9b2548): created successfully Jul 21 19:08:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20e82cd-ac09-4f6c-b69d-189711ea9336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Flow 'volume_create_manager' (e1975ce0-7c43-49fe-a9ec-5b95c6e96f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:34 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c Jul 21 19:08:34 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:34 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c9931a5a-dd7e-490a-8f22-39ed3cf636e7 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Created volume successfully. Jul 21 19:08:34 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c" returned: 0 in 0.611s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:34 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 Jul 21 19:08:34 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Creating offline snapshot d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 of volume e6372a3b-3323-44be-a708-710a2b9b2548 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:08:35 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c10e1c-cb4f-4579-9bbe-5eccd5fd6efd]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:35 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548 Jul 21 19:08:35 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:35 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573" returned: 0 in 0.887s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:35 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573 Jul 21 19:08:35 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:35 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548" returned: 0 in 0.751s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 2G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:35 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 2G Jul 21 19:08:35 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:36 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c.f0e71098-8f1e-4b96-a587-3e74f9f7c573" returned: 0 in 0.522s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-f0e71098-8f1e-4b96-a587-3e74f9f7c573" released by "_delete_snapshot" :: held 2.895s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-0e1d494d-2a7d-4c62-966c-0d33156c833c" released by "delete_snapshot" :: held 2.943s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Created reservations ['e01c5806-88d6-4c52-bcc6-ea8a5b446389', 'b0815dc8-d559-4be4-b6cb-81c723173d09', 'cdf82bf2-88e8-40ac-a18e-dce51d46d086', '77412267-f61e-4938-bf5b-41eb874f9bb9'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:36 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Delete snapshot completed successfully. Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-f0e71098-8f1e-4b96-a587-3e74f9f7c573-delete_snapshot" released by "delete_snapshot" :: held 3.212s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Snapshots deleted, issuing volume delete {{(pid=87487) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-quobyte-0e1d494d-2a7d-4c62-966c-0d33156c833c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-0e1d494d-2a7d-4c62-966c-0d33156c833c" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ecaf91-c683-4ecc-864b-3ddc9794ffef]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:36 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 2G" returned: 0 in 0.642s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6372a3b-3323-44be-a708-710a2b9b2548 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:36 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6372a3b-3323-44be-a708-710a2b9b2548 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 Jul 21 19:08:36 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:36 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c Jul 21 19:08:36 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:36 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c" returned: 0 in 0.540s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:36 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6372a3b-3323-44be-a708-710a2b9b2548 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5" returned: 0 in 0.486s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:36 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 is being set with open permissions: ugo+rw Jul 21 19:08:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:37 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c Jul 21 19:08:37 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:37 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 Jul 21 19:08:37 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:37 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5" returned: 0 in 0.351s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:37 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0e1d494d-2a7d-4c62-966c-0d33156c833c" returned: 0 in 0.392s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-0e1d494d-2a7d-4c62-966c-0d33156c833c" released by "delete_volume" :: held 1.046s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:37 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.info Jul 21 19:08:37 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:37 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Created reservations ['c76a44c2-aa11-4a07-a3bb-439ddd649fde', 'cf765381-69f4-4432-9065-b12edf25a6a5', 'bfff0c0f-5d59-41fa-82d9-841f24d30421', '761de643-75d5-4653-bcb0-98aac89571ca'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:37 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:08:37 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:37 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.info" returned: 0 in 0.566s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:38 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.info is being set with open permissions: ugo+rw Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-9640ef8c-7932-422b-a8da-015c7d549048-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:38 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.info Jul 21 19:08:38 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-9640ef8c-7932-422b-a8da-015c7d549048-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:38 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "cinder-quobyte-9640ef8c-7932-422b-a8da-015c7d549048" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.531s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:38 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Deleted volume successfully. Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-9640ef8c-7932-422b-a8da-015c7d549048" acquired by "delete_volume" :: waited 0.033s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b5bce5b9-73e7-4d01-8a0c-b708be01bf72 tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-0e1d494d-2a7d-4c62-966c-0d33156c833c-delete_volume" released by "delete_volume" :: held 5.315s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[264cf7a2-9321-419b-af8a-8e0089bc4684]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:38 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.info" returned: 0 in 0.518s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:38 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048 Jul 21 19:08:38 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.502s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:38 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-11cdb84f-3e65-4282-ae11-e03dd6035d23 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Create snapshot completed successfully Jul 21 19:08:38 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048" returned: 0 in 0.630s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:39 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048 Jul 21 19:08:39 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:39 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9640ef8c-7932-422b-a8da-015c7d549048" returned: 0 in 0.408s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-quobyte-9640ef8c-7932-422b-a8da-015c7d549048" released by "delete_volume" :: held 1.138s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Created reservations ['8b0426c2-d43a-4468-9bb2-db18db019d88', '5eed83c3-4787-451a-9eda-10be5bd13e48', '5279ebbb-9d36-47a5-ae64-b7db4d9019cd', '01779101-e646-449c-8fb8-1da12ee708bd'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:39 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:08:39 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Acquiring lock "cinder-d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "cinder-d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Acquiring lock "cinder-quobyte-e6372a3b-3323-44be-a708-710a2b9b2548" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "cinder-quobyte-e6372a3b-3323-44be-a708-710a2b9b2548" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Acquiring lock "cinder-quobyte-d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "cinder-quobyte-d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Deleting offline snapshot d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 of volume e6372a3b-3323-44be-a708-710a2b9b2548 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] snapshot_file for this snap is: volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60aa18d-f1c7-4f34-bcbb-850e61ba7358]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:40 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.478s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:40 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 Jul 21 19:08:40 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:40 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:40 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Deleted volume successfully. Jul 21 19:08:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-28448e6b-fe32-44d9-8dfa-dcf3d7d1248d tempest-VolumesDeleteCascade-340170452 None] Lock "cinder-9640ef8c-7932-422b-a8da-015c7d549048-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:40 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5" returned: 0 in 0.555s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6372a3b-3323-44be-a708-710a2b9b2548(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:40 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be83a4b-0826-4feb-a8c0-aa38342d0c62]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:08:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:40 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:08:40 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:40 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548 Jul 21 19:08:40 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:41 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.412s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:41 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:41 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:08:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:08:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:08:41 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548" returned: 0 in 0.617s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:41 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 Jul 21 19:08:41 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:41 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5" returned: 0 in 0.635s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:41 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5 Jul 21 19:08:41 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:42 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548.d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5" returned: 0 in 0.585s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "cinder-quobyte-d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5" released by "_delete_snapshot" :: held 2.594s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "cinder-quobyte-e6372a3b-3323-44be-a708-710a2b9b2548" released by "delete_snapshot" :: held 2.638s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:42 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Created reservations ['74ac56a6-07e2-4cf9-9703-f3dff7cc1018', '8718186c-cb7e-49a7-ae54-49204f17bc1f', 'd0c54398-dc47-4341-8139-56f5bb35327a', '53a3bc0a-dd9b-4fa3-aeca-404328737787'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:42 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Delete snapshot completed successfully. Jul 21 19:08:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99497a24-e415-4176-bad0-43417288b970 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "cinder-d4aa3d83-4be3-46de-a0a1-f2d7e24b12d5-delete_snapshot" released by "delete_snapshot" :: held 3.001s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Flow 'volume_create_manager' (81189a6a-c8fa-43f7-bfbc-5634338c5071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f7bb81-075e-4164-a530-bdfeacb122a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f7bb81-075e-4164-a530-bdfeacb122a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1665088529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8268f55-dfe2-4a11-b8b8-5568d3832b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dac25612b5a425bb9609b682c1ed721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:43Z,use_quota=True,user_id='b6663f9d275140628c1464616eed29ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9807ce49-2a97-4b02-b8e6-2f9b13f46668),volume_type_id=9807ce49-2a97-4b02-b8e6-2f9b13f46668)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96f3d4d-9adb-4eda-9de6-7aeb2fe298a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96f3d4d-9adb-4eda-9de6-7aeb2fe298a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9131fd57-db8c-4dc8-973c-ef636d62b875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9131fd57-db8c-4dc8-973c-ef636d62b875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8268f55-dfe2-4a11-b8b8-5568d3832b58', 'volume_name': 'volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bcae10a-a196-465e-b82a-03e5342e7b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bcae10a-a196-465e-b82a-03e5342e7b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09863c8b-e5cb-4752-8e41-126bae905b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Volume e8268f55-dfe2-4a11-b8b8-5568d3832b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58', 'volume_size': 1} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1665088529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8268f55-dfe2-4a11-b8b8-5568d3832b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dac25612b5a425bb9609b682c1ed721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:43Z,use_quota=True,user_id='b6663f9d275140628c1464616eed29ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9807ce49-2a97-4b02-b8e6-2f9b13f46668),volume_type_id=9807ce49-2a97-4b02-b8e6-2f9b13f46668)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Creating volume e8268f55-dfe2-4a11-b8b8-5568d3832b58 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:43 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Acquiring lock "cinder-e6372a3b-3323-44be-a708-710a2b9b2548-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "cinder-e6372a3b-3323-44be-a708-710a2b9b2548-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:43 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58 1073741824 Jul 21 19:08:43 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Acquiring lock "cinder-quobyte-e6372a3b-3323-44be-a708-710a2b9b2548" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "cinder-quobyte-e6372a3b-3323-44be-a708-710a2b9b2548" acquired by "delete_volume" :: waited 0.035s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f45b44-09ad-430f-9604-344cafe2e616]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:43 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548 Jul 21 19:08:43 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Flow 'volume_create_manager' (70620f10-b09f-4886-bf3f-989e9ad7c1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b10088-f57a-4c3c-8c94-4a2630d89eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b10088-f57a-4c3c-8c94-4a2630d89eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-90224604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f34d682-688c-4dfa-99b6-04a804a191fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dac25612b5a425bb9609b682c1ed721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:44Z,use_quota=True,user_id='b6663f9d275140628c1464616eed29ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8345511-3714-4106-a6be-34f7d43e145e),volume_type_id=f8345511-3714-4106-a6be-34f7d43e145e)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebddfda-abaf-492d-a9a5-69208e1da12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebddfda-abaf-492d-a9a5-69208e1da12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2220ab36-cda0-499a-a43d-3fb42c9ae1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2220ab36-cda0-499a-a43d-3fb42c9ae1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f34d682-688c-4dfa-99b6-04a804a191fc', 'volume_name': 'volume-6f34d682-688c-4dfa-99b6-04a804a191fc', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e556dc-1da4-4c7e-badc-354dd29a023c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e556dc-1da4-4c7e-badc-354dd29a023c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5d4ea9-3be9-4d4c-9d5b-12a8c78f8417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Volume 6f34d682-688c-4dfa-99b6-04a804a191fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f34d682-688c-4dfa-99b6-04a804a191fc', 'volume_size': 1} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:43 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58 1073741824" returned: 0 in 0.731s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:43 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58 Jul 21 19:08:43 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:44 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548" returned: 0 in 0.753s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:44 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548 Jul 21 19:08:44 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:44 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58" returned: 0 in 0.544s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.686s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-90224604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f34d682-688c-4dfa-99b6-04a804a191fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dac25612b5a425bb9609b682c1ed721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:44Z,use_quota=True,user_id='b6663f9d275140628c1464616eed29ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8345511-3714-4106-a6be-34f7d43e145e),volume_type_id=f8345511-3714-4106-a6be-34f7d43e145e)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Creating volume 6f34d682-688c-4dfa-99b6-04a804a191fc {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:44 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f34d682-688c-4dfa-99b6-04a804a191fc 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:44 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:44 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f34d682-688c-4dfa-99b6-04a804a191fc 1073741824 Jul 21 19:08:44 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09863c8b-e5cb-4752-8e41-126bae905b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d7ee1b-1beb-4cbd-8c60-6c151bef2772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e6372a3b-3323-44be-a708-710a2b9b2548" returned: 0 in 0.401s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "cinder-quobyte-e6372a3b-3323-44be-a708-710a2b9b2548" released by "delete_volume" :: held 1.273s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:44 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Volume volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58 (e8268f55-dfe2-4a11-b8b8-5568d3832b58): created successfully Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d7ee1b-1beb-4cbd-8c60-6c151bef2772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Flow 'volume_create_manager' (81189a6a-c8fa-43f7-bfbc-5634338c5071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:44 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ffb920c9-331f-423d-8de3-ac4cb0340204 tempest-TestInstancesWithCinderVolumes-1776198903 None] Created volume successfully. Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Created reservations ['4b6f9b18-3a23-4218-9ef7-49cfe95c3d28', '92156ad1-d253-46e9-9d49-eea1238fdb3e', '219646d8-a6e5-4136-bc05-b55723958c9b', 'bf1cd27a-cf15-4b09-a909-191d1c71ac98'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Flow 'volume_create_manager' (1b6fc863-3e29-4726-9261-6cf6f38c0929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7845db-c6de-4db2-a609-87fcdc4ebdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7845db-c6de-4db2-a609-87fcdc4ebdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1573470746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dac25612b5a425bb9609b682c1ed721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:45Z,use_quota=True,user_id='b6663f9d275140628c1464616eed29ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c14d2b2d-29a1-4a80-b95c-36635c22b494),volume_type_id=c14d2b2d-29a1-4a80-b95c-36635c22b494)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25d88ab-1d20-4567-8c9e-af45b9edc98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25d88ab-1d20-4567-8c9e-af45b9edc98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58312591-4c3f-41b9-8beb-523218371ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG cinder.image.glance [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Creating Keystone auth plugin from conf {{(pid=87487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:08:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:45 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:08:45 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:45 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f34d682-688c-4dfa-99b6-04a804a191fc 1073741824" returned: 0 in 0.647s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f34d682-688c-4dfa-99b6-04a804a191fc {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:45 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f34d682-688c-4dfa-99b6-04a804a191fc Jul 21 19:08:45 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:45 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.399s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:45 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Deleted volume successfully. Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-308d3b0d-7ec3-49f1-adb4-d41fb32f6052 tempest-VolumesSnapshotNegativeTestJSON-2087917258 None] Lock "cinder-e6372a3b-3323-44be-a708-710a2b9b2548-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:45 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f34d682-688c-4dfa-99b6-04a804a191fc" returned: 0 in 0.348s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5d4ea9-3be9-4d4c-9d5b-12a8c78f8417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f34d682-688c-4dfa-99b6-04a804a191fc', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04842a29-ebce-4b91-b4a3-96b3a9769ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58312591-4c3f-41b9-8beb-523218371ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6', 'volume_name': 'volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6', 'volume_size': 1, 'image_id': '744d58f7-3488-47e0-af0d-c5475db09b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/744d58f7-3488-47e0-af0d-c5475db09b6f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1766478360', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dac25612b5a425bb9609b682c1ed721', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '744d58f7-3488-47e0-af0d-c5475db09b6f', 'created_at': datetime.datetime(2026, 7, 21, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/744d58f7-3488-47e0-af0d-c5475db09b6f/file', 'properties': {}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c06c20-bcbe-4bf8-8567-ec2f2949a86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c06c20-bcbe-4bf8-8567-ec2f2949a86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d0a5e8-dff5-430a-896e-407dc56a9ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:45 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Volume 5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6', 'volume_size': 1, 'image_id': '744d58f7-3488-47e0-af0d-c5475db09b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/744d58f7-3488-47e0-af0d-c5475db09b6f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1766478360', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dac25612b5a425bb9609b682c1ed721', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '744d58f7-3488-47e0-af0d-c5475db09b6f', 'created_at': datetime.datetime(2026, 7, 21, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/744d58f7-3488-47e0-af0d-c5475db09b6f/file', 'properties': {}}, 'image_service': } Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Trying to clone 5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 from image 744d58f7-3488-47e0-af0d-c5475db09b6f at location (None, [{'url': 'file:///opt/stack/data/glance/images/744d58f7-3488-47e0-af0d-c5475db09b6f', 'metadata': {}}]). {{(pid=87487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:08:45 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Volume volume-6f34d682-688c-4dfa-99b6-04a804a191fc (6f34d682-688c-4dfa-99b6-04a804a191fc): created successfully Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04842a29-ebce-4b91-b4a3-96b3a9769ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Flow 'volume_create_manager' (70620f10-b09f-4886-bf3f-989e9ad7c1f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:45 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d87bbb6f-e29c-4c1d-8af1-caae2e503758 tempest-TestInstancesWithCinderVolumes-1776198903 None] Created volume successfully. Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Flow 'volume_create_manager' (d96a974a-adbb-442a-a17c-c868f980b31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc6f880-db0d-4d8b-8bab-ef15b350022b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc6f880-db0d-4d8b-8bab-ef15b350022b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2120150603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5b9c3a-e6cc-428c-9638-141b452f514a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='932824cdde9b41c6a2bc1f3e8f966013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:48Z,use_quota=True,user_id='d22a2b124d38472aaa2d09c752c27e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e3b27b-06dd-473c-938f-cadb224282c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e3b27b-06dd-473c-938f-cadb224282c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d8c7ed-e377-48b3-8ebc-843efba745cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d8c7ed-e377-48b3-8ebc-843efba745cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a5b9c3a-e6cc-428c-9638-141b452f514a', 'volume_name': 'volume-6a5b9c3a-e6cc-428c-9638-141b452f514a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d4e05b-06b7-456a-8b61-c0035e13a350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d4e05b-06b7-456a-8b61-c0035e13a350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71e5548-8f65-46c2-aaf9-cb47d03c9e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:47 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Volume 6a5b9c3a-e6cc-428c-9638-141b452f514a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a5b9c3a-e6cc-428c-9638-141b452f514a', 'volume_size': 1} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2120150603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5b9c3a-e6cc-428c-9638-141b452f514a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='932824cdde9b41c6a2bc1f3e8f966013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:48Z,use_quota=True,user_id='d22a2b124d38472aaa2d09c752c27e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Creating volume 6a5b9c3a-e6cc-428c-9638-141b452f514a {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:47 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:08:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6a5b9c3a-e6cc-428c-9638-141b452f514a 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:47 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6a5b9c3a-e6cc-428c-9638-141b452f514a 1073741824 Jul 21 19:08:47 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:48 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6a5b9c3a-e6cc-428c-9638-141b452f514a 1073741824" returned: 0 in 0.508s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6a5b9c3a-e6cc-428c-9638-141b452f514a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:48 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6a5b9c3a-e6cc-428c-9638-141b452f514a Jul 21 19:08:48 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:48 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6a5b9c3a-e6cc-428c-9638-141b452f514a" returned: 0 in 0.282s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71e5548-8f65-46c2-aaf9-cb47d03c9e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a5b9c3a-e6cc-428c-9638-141b452f514a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7da1de-2366-46b1-8f07-eaa716f2f635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:48 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Volume volume-6a5b9c3a-e6cc-428c-9638-141b452f514a (6a5b9c3a-e6cc-428c-9638-141b452f514a): created successfully Jul 21 19:08:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7da1de-2366-46b1-8f07-eaa716f2f635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Flow 'volume_create_manager' (d96a974a-adbb-442a-a17c-c868f980b31a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:48 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c1989998-3474-4be3-b443-cce111d0efaf tempest-VolumesTransfersTest-51129767 None] Created volume successfully. Jul 21 19:08:49 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_744d58f7-3488-47e0-af0d-c5475db09b6f_682zh10bdevstack@QuobyteHD, size 20.69 MB, duration 3.97 sec {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:08:49 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Image download 20.69 MB at 5.22 MB/s Jul 21 19:08:49 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6693acd8-0f4b-48dc-ae89-928909ef5b40]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_744d58f7-3488-47e0-af0d-c5475db09b6f_682zh10bdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:49 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_744d58f7-3488-47e0-af0d-c5475db09b6f_682zh10bdevstack@QuobyteHD Jul 21 19:08:49 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:50 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_744d58f7-3488-47e0-af0d-c5475db09b6f_682zh10bdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Temporary image 744d58f7-3488-47e0-af0d-c5475db09b6f is fetched for user b6663f9d275140628c1464616eed29ec. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b55fff-f1b7-4950-8a8a-d932199a634a]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_744d58f7-3488-47e0-af0d-c5475db09b6f_682zh10bdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:50 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_744d58f7-3488-47e0-af0d-c5475db09b6f_682zh10bdevstack@QuobyteHD Jul 21 19:08:50 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:50 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d4b23b48-f427-4165-9313-bf9cdd0631e1 tempest-VolumesTransfersTest-670976757 None] Transfer volume completed successfully. Jul 21 19:08:50 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_744d58f7-3488-47e0-af0d-c5475db09b6f_682zh10bdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1573470746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dac25612b5a425bb9609b682c1ed721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:45Z,use_quota=True,user_id='b6663f9d275140628c1464616eed29ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c14d2b2d-29a1-4a80-b95c-36635c22b494),volume_type_id=c14d2b2d-29a1-4a80-b95c-36635c22b494)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Creating volume 5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:50 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:08:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:50 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 1073741824 Jul 21 19:08:50 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:51 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 1073741824" returned: 0 in 0.526s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:51 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 Jul 21 19:08:51 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Acquiring lock "cinder-6a5b9c3a-e6cc-428c-9638-141b452f514a-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Lock "cinder-6a5b9c3a-e6cc-428c-9638-141b452f514a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Acquiring lock "cinder-quobyte-6a5b9c3a-e6cc-428c-9638-141b452f514a" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Lock "cinder-quobyte-6a5b9c3a-e6cc-428c-9638-141b452f514a" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b133fba7-d104-4fe0-b227-842dddce7848]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6a5b9c3a-e6cc-428c-9638-141b452f514a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:51 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6" returned: 0 in 0.353s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:51 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6a5b9c3a-e6cc-428c-9638-141b452f514a Jul 21 19:08:51 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Attempting download of 744d58f7-3488-47e0-af0d-c5475db09b6f ((None, [{'url': 'file:///opt/stack/data/glance/images/744d58f7-3488-47e0-af0d-c5475db09b6f', 'metadata': {}}])) to volume 5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f87287-f33d-4c7d-8edd-9e03c0d2a35d]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_744d58f7-3488-47e0-af0d-c5475db09b6f_sb04oksc {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:51 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_744d58f7-3488-47e0-af0d-c5475db09b6f_sb04oksc Jul 21 19:08:51 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:51 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6a5b9c3a-e6cc-428c-9638-141b452f514a" returned: 0 in 0.417s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6a5b9c3a-e6cc-428c-9638-141b452f514a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:51 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6a5b9c3a-e6cc-428c-9638-141b452f514a Jul 21 19:08:51 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:51 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_744d58f7-3488-47e0-af0d-c5475db09b6f_sb04oksc" returned: 0 in 0.412s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_744d58f7-3488-47e0-af0d-c5475db09b6f_sb04oksc {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:52 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6a5b9c3a-e6cc-428c-9638-141b452f514a" returned: 0 in 0.302s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Lock "cinder-quobyte-6a5b9c3a-e6cc-428c-9638-141b452f514a" released by "delete_volume" :: held 0.789s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:52 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_744d58f7-3488-47e0-af0d-c5475db09b6f_sb04oksc Jul 21 19:08:52 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Created reservations ['89e48623-21a3-4e3a-b756-4d868d0293a5', '1c8be442-3405-4946-bbdb-fbd1858de345', '9e87d3d4-7164-48c0-9c1c-33994fb8581b', '9839de48-0e1b-46f5-9741-2159a54957ad'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:52 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_744d58f7-3488-47e0-af0d-c5475db09b6f_sb04oksc" returned: 1 in 0.517s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_744d58f7-3488-47e0-af0d-c5475db09b6f_sb04oksc' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f960c23-fdfc-4ba5-9a65-9a71c379167f]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_744d58f7-3488-47e0-af0d-c5475db09b6f_682zh10bdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:52 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_744d58f7-3488-47e0-af0d-c5475db09b6f_682zh10bdevstack@QuobyteHD Jul 21 19:08:52 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:52 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:08:52 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:52 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:52 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_744d58f7-3488-47e0-af0d-c5475db09b6f_682zh10bdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.274s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] 744d58f7-3488-47e0-af0d-c5475db09b6f was qcow2, converting to qcow2 {{(pid=87487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_744d58f7-3488-47e0-af0d-c5475db09b6f_682zh10bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:52 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Deleted volume successfully. Jul 21 19:08:52 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_744d58f7-3488-47e0-af0d-c5475db09b6f_682zh10bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 Jul 21 19:08:52 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-aaeb4583-ca67-4e16-b661-c266223e8f7b tempest-VolumesTransfersTest-1388911128 None] Lock "cinder-6a5b9c3a-e6cc-428c-9638-141b452f514a-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Flow 'volume_create_manager' (abe5b2a8-c019-459f-b27b-6302cf465f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa356ea5-95c5-4727-9659-7b7312f945b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa356ea5-95c5-4727-9659-7b7312f945b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1026894901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7923eb27-3165-4da8-ba8c-60394834edb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='932824cdde9b41c6a2bc1f3e8f966013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:54Z,use_quota=True,user_id='d22a2b124d38472aaa2d09c752c27e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3677fa-654e-4a3f-9418-1ae7d7782673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3677fa-654e-4a3f-9418-1ae7d7782673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ef80f8-2a83-4237-aaab-2eaa2f0d0f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ef80f8-2a83-4237-aaab-2eaa2f0d0f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7923eb27-3165-4da8-ba8c-60394834edb1', 'volume_name': 'volume-7923eb27-3165-4da8-ba8c-60394834edb1', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce484ced-c31c-4713-9d61-9e05d76e76d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce484ced-c31c-4713-9d61-9e05d76e76d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768b7c9f-f630-4253-b8cf-fef66f313491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:54 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Volume 7923eb27-3165-4da8-ba8c-60394834edb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7923eb27-3165-4da8-ba8c-60394834edb1', 'volume_size': 1} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1026894901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7923eb27-3165-4da8-ba8c-60394834edb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='932824cdde9b41c6a2bc1f3e8f966013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:54Z,use_quota=True,user_id='d22a2b124d38472aaa2d09c752c27e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Creating volume 7923eb27-3165-4da8-ba8c-60394834edb1 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:54 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7923eb27-3165-4da8-ba8c-60394834edb1 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:54 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7923eb27-3165-4da8-ba8c-60394834edb1 1073741824 Jul 21 19:08:54 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:54 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7923eb27-3165-4da8-ba8c-60394834edb1 1073741824" returned: 0 in 0.656s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7923eb27-3165-4da8-ba8c-60394834edb1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:55 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7923eb27-3165-4da8-ba8c-60394834edb1 Jul 21 19:08:55 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:55 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_744d58f7-3488-47e0-af0d-c5475db09b6f_682zh10bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6" returned: 0 in 2.307s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:55 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_744d58f7-3488-47e0-af0d-c5475db09b6f_682zh10bdevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:08:55 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Converted 112.00 MB image at 48.51 MB/s Jul 21 19:08:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:55 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 1G Jul 21 19:08:55 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:55 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7923eb27-3165-4da8-ba8c-60394834edb1" returned: 0 in 0.328s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768b7c9f-f630-4253-b8cf-fef66f313491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7923eb27-3165-4da8-ba8c-60394834edb1', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd025d9b-1f69-4ce3-91ba-1079f610032d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:55 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 1G" returned: 0 in 0.533s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:55 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Downloaded image 744d58f7-3488-47e0-af0d-c5475db09b6f ((None, [{'url': 'file:///opt/stack/data/glance/images/744d58f7-3488-47e0-af0d-c5475db09b6f', 'metadata': {}}])) to volume 5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 successfully. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:08:55 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Temporary image 744d58f7-3488-47e0-af0d-c5475db09b6f for user b6663f9d275140628c1464616eed29ec is deleted. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:08:55 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Marking volume 5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 as bootable. {{(pid=87487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:08:56 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Volume volume-7923eb27-3165-4da8-ba8c-60394834edb1 (7923eb27-3165-4da8-ba8c-60394834edb1): created successfully Jul 21 19:08:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd025d9b-1f69-4ce3-91ba-1079f610032d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Flow 'volume_create_manager' (abe5b2a8-c019-459f-b27b-6302cf465f54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:57 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-098a4930-e223-4546-9230-46fa62df8036 tempest-VolumesTransfersTest-51129767 None] Created volume successfully. Jul 21 19:08:57 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Copying metadata from image 744d58f7-3488-47e0-af0d-c5475db09b6f to 5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6. {{(pid=87487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:08:57 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Creating volume glance metadata for volume 5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 backed by image 744d58f7-3488-47e0-af0d-c5475db09b6f with: {'image_id': '744d58f7-3488-47e0-af0d-c5475db09b6f', 'image_name': 'tempest-scenario-img--1766478360', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:09:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d0a5e8-dff5-430a-896e-407dc56a9ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6', 'volume_size': 1, 'image_id': '744d58f7-3488-47e0-af0d-c5475db09b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/744d58f7-3488-47e0-af0d-c5475db09b6f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1766478360', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0dac25612b5a425bb9609b682c1ed721', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '744d58f7-3488-47e0-af0d-c5475db09b6f', 'created_at': datetime.datetime(2026, 7, 21, 17, 8, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 8, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/744d58f7-3488-47e0-af0d-c5475db09b6f/file', 'properties': {}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683f3f6e-5bb1-4850-8dd3-8fda18fe4c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:00 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Volume volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 (5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6): created successfully Jul 21 19:09:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683f3f6e-5bb1-4850-8dd3-8fda18fe4c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Flow 'volume_create_manager' (1b6fc863-3e29-4726-9261-6cf6f38c0929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:00 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-8c95a2a7-9c7f-41d9-a530-fd5f32151f8c tempest-TestInstancesWithCinderVolumes-1776198903 None] Created volume successfully. Jul 21 19:09:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Acquiring lock "cinder-7923eb27-3165-4da8-ba8c-60394834edb1-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Lock "cinder-7923eb27-3165-4da8-ba8c-60394834edb1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Acquiring lock "cinder-quobyte-7923eb27-3165-4da8-ba8c-60394834edb1" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Lock "cinder-quobyte-7923eb27-3165-4da8-ba8c-60394834edb1" acquired by "delete_volume" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:00 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa309a3d-ccb0-4117-9341-09dfcfe15206]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7923eb27-3165-4da8-ba8c-60394834edb1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:00 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7923eb27-3165-4da8-ba8c-60394834edb1 Jul 21 19:09:00 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:01 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7923eb27-3165-4da8-ba8c-60394834edb1" returned: 0 in 0.489s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7923eb27-3165-4da8-ba8c-60394834edb1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:01 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7923eb27-3165-4da8-ba8c-60394834edb1 Jul 21 19:09:01 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:01 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7923eb27-3165-4da8-ba8c-60394834edb1" returned: 0 in 0.353s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Lock "cinder-quobyte-7923eb27-3165-4da8-ba8c-60394834edb1" released by "delete_volume" :: held 0.925s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:01 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Created reservations ['7b5ef131-75a1-44ea-9131-d91007f4c866', '4d017dd9-e6e0-4331-b4f9-7094f7f6aa53', 'bed0a551-08da-4596-b42c-0089c3af4648', '2e39b095-3a26-40d0-ad30-214f18c06a99'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:09:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:01 devstack sudo[96095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:09:01 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:02 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.508s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:02 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:09:02 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Deleted volume successfully. Jul 21 19:09:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-529afc6c-c87a-4282-9a59-570d8536992c tempest-VolumesTransfersTest-1388911128 None] Lock "cinder-7923eb27-3165-4da8-ba8c-60394834edb1-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-01d11b61-a79d-4dc7-93cb-c1521ad5c8e8 req-cac65e56-9c0f-430a-9eec-1a55e4b659b8 tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-01d11b61-a79d-4dc7-93cb-c1521ad5c8e8 req-cac65e56-9c0f-430a-9eec-1a55e4b659b8 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-01d11b61-a79d-4dc7-93cb-c1521ad5c8e8 req-cac65e56-9c0f-430a-9eec-1a55e4b659b8 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-01d11b61-a79d-4dc7-93cb-c1521ad5c8e8 req-cac65e56-9c0f-430a-9eec-1a55e4b659b8 tempest-TestInstancesWithCinderVolumes-1776198903 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b5465f1-4cda-4525-ae6c-910ec04a4ae1', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:09:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-01d11b61-a79d-4dc7-93cb-c1521ad5c8e8 req-cac65e56-9c0f-430a-9eec-1a55e4b659b8 tempest-TestInstancesWithCinderVolumes-1776198903 None] attachment_update completed successfully. Jul 21 19:09:12 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=117,cinder:UPDATE=126,cinder:DELETE=10,cinder:INSERT=37 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:09:12 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=111,cinder:UPDATE=127,cinder:DELETE=10,cinder:INSERT=37 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:09:12 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:09:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Flow 'volume_create_manager' (200e320e-44b0-4508-a60c-c4e1f6459da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b10eb9-765f-473b-8aa1-935877a70c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b10eb9-765f-473b-8aa1-935877a70c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1965424756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af51b65-b868-4b85-a667-93d29b19104b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e584ca81ae7a479288f1a1566f9c26ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:13Z,use_quota=True,user_id='ee8a5f9f78124166a390afd4a4ed1783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62494754-5c1c-401c-aab2-fbc5eb609c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62494754-5c1c-401c-aab2-fbc5eb609c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fcc93b-cdf8-40e2-8151-20487617296a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fcc93b-cdf8-40e2-8151-20487617296a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7af51b65-b868-4b85-a667-93d29b19104b', 'volume_name': 'volume-7af51b65-b868-4b85-a667-93d29b19104b', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d58ddd-7676-4fbd-8823-56f7974aece6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d58ddd-7676-4fbd-8823-56f7974aece6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c2439c-7226-4fc0-b7b7-44fe3a7261fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:13 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Volume 7af51b65-b868-4b85-a667-93d29b19104b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7af51b65-b868-4b85-a667-93d29b19104b', 'volume_size': 1} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1965424756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af51b65-b868-4b85-a667-93d29b19104b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e584ca81ae7a479288f1a1566f9c26ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:13Z,use_quota=True,user_id='ee8a5f9f78124166a390afd4a4ed1783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Creating volume 7af51b65-b868-4b85-a667-93d29b19104b {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:09:13 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:09:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7af51b65-b868-4b85-a667-93d29b19104b 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:13 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7af51b65-b868-4b85-a667-93d29b19104b 1073741824 Jul 21 19:09:13 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:13 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7af51b65-b868-4b85-a667-93d29b19104b 1073741824" returned: 0 in 0.940s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7af51b65-b868-4b85-a667-93d29b19104b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:14 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7af51b65-b868-4b85-a667-93d29b19104b Jul 21 19:09:14 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:14 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7af51b65-b868-4b85-a667-93d29b19104b" returned: 0 in 0.705s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:09:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c2439c-7226-4fc0-b7b7-44fe3a7261fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7af51b65-b868-4b85-a667-93d29b19104b', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8f31ea-526f-4aff-868d-17ba0cf18c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:14 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Volume volume-7af51b65-b868-4b85-a667-93d29b19104b (7af51b65-b868-4b85-a667-93d29b19104b): created successfully Jul 21 19:09:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8f31ea-526f-4aff-868d-17ba0cf18c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Flow 'volume_create_manager' (200e320e-44b0-4508-a60c-c4e1f6459da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:14 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-937c37ff-c808-4af1-8ad8-269d117aa551 tempest-VolumesListTestJSON-2036595222 None] Created volume successfully. Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Flow 'volume_create_manager' (6fdb26d9-18ab-4754-a890-dc7253fc51e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f87905c-1cd3-407e-b6eb-4cb23eb25faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f87905c-1cd3-407e-b6eb-4cb23eb25faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-705113212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e584ca81ae7a479288f1a1566f9c26ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:16Z,use_quota=True,user_id='ee8a5f9f78124166a390afd4a4ed1783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72620dd-262b-4468-9313-08cf0be36550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72620dd-262b-4468-9313-08cf0be36550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efca3583-50d9-4bbd-95a6-21d1a9415e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efca3583-50d9-4bbd-95a6-21d1a9415e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233', 'volume_name': 'volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ab6edb-047f-4971-b2e2-32644fea2f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ab6edb-047f-4971-b2e2-32644fea2f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b7d217-2dfa-4b9f-9ed8-8f8154a2489f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:16 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Volume 12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233', 'volume_size': 1} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-705113212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e584ca81ae7a479288f1a1566f9c26ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:16Z,use_quota=True,user_id='ee8a5f9f78124166a390afd4a4ed1783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Creating volume 12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:09:16 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:16 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233 1073741824 Jul 21 19:09:16 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:16 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233 1073741824" returned: 0 in 0.583s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:16 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233 Jul 21 19:09:16 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:17 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233" returned: 0 in 0.419s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:09:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b7d217-2dfa-4b9f-9ed8-8f8154a2489f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f30c44d-dfd9-4069-afe6-7b442dea4765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:17 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Volume volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233 (12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233): created successfully Jul 21 19:09:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f30c44d-dfd9-4069-afe6-7b442dea4765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Flow 'volume_create_manager' (6fdb26d9-18ab-4754-a890-dc7253fc51e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:17 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-eee2b2f1-8543-4d9d-83b8-b969e97c95c6 tempest-VolumesListTestJSON-2036595222 None] Created volume successfully. Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Flow 'volume_create_manager' (52af1a5e-938c-4e48-9f45-16f22813ba5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6717c0d-a75d-490d-b82c-5356faf9a1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6717c0d-a75d-490d-b82c-5356faf9a1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-902629747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8023f5b-3523-49e3-a9ec-9b9de7f594e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e584ca81ae7a479288f1a1566f9c26ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:19Z,use_quota=True,user_id='ee8a5f9f78124166a390afd4a4ed1783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b670238-442a-4c24-be4d-2ac6e6f39f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b670238-442a-4c24-be4d-2ac6e6f39f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cd7a84-454f-476b-bb5f-23712585a26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cd7a84-454f-476b-bb5f-23712585a26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8023f5b-3523-49e3-a9ec-9b9de7f594e1', 'volume_name': 'volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9b7922-351b-4672-9ae2-695e71da77aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9b7922-351b-4672-9ae2-695e71da77aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9987bcb8-7ff9-4a37-9b80-cb3b1a27ef95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:19 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Volume e8023f5b-3523-49e3-a9ec-9b9de7f594e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1', 'volume_size': 1} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-902629747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8023f5b-3523-49e3-a9ec-9b9de7f594e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e584ca81ae7a479288f1a1566f9c26ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:19Z,use_quota=True,user_id='ee8a5f9f78124166a390afd4a4ed1783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Creating volume e8023f5b-3523-49e3-a9ec-9b9de7f594e1 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:09:19 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:09:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:19 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1 1073741824 Jul 21 19:09:19 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:20 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1 1073741824" returned: 0 in 0.672s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:20 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1 Jul 21 19:09:20 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:20 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1" returned: 0 in 0.388s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:09:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9987bcb8-7ff9-4a37-9b80-cb3b1a27ef95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dce5bea-79c2-4156-bd9e-eadcfb1cd48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:20 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Volume volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1 (e8023f5b-3523-49e3-a9ec-9b9de7f594e1): created successfully Jul 21 19:09:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dce5bea-79c2-4156-bd9e-eadcfb1cd48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Flow 'volume_create_manager' (52af1a5e-938c-4e48-9f45-16f22813ba5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:20 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-48b7ef9e-9b08-4b8b-89ff-765522a3fc64 tempest-VolumesListTestJSON-2036595222 None] Created volume successfully. Jul 21 19:09:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "cinder-e8023f5b-3523-49e3-a9ec-9b9de7f594e1-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Lock "cinder-e8023f5b-3523-49e3-a9ec-9b9de7f594e1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "cinder-quobyte-e8023f5b-3523-49e3-a9ec-9b9de7f594e1" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Lock "cinder-quobyte-e8023f5b-3523-49e3-a9ec-9b9de7f594e1" acquired by "delete_volume" :: waited 0.039s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:26 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fc4ab7-bbd2-4c88-963c-7ca158872d14]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:26 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1 Jul 21 19:09:26 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:27 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1" returned: 0 in 1.175s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:27 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1 Jul 21 19:09:27 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:28 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8023f5b-3523-49e3-a9ec-9b9de7f594e1" returned: 0 in 0.581s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Lock "cinder-quobyte-e8023f5b-3523-49e3-a9ec-9b9de7f594e1" released by "delete_volume" :: held 1.898s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:28 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Created reservations ['c11e886e-6c14-4576-ac3a-65745bf3e789', 'd96a4a84-c416-47df-8a06-b77a8de5217a', '68d2a1ff-e49c-4fa9-80a3-6bedfc6325a7', 'ca7ae8dd-c2c3-4fb0-adcd-dccd7aa937d1'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:09:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:28 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:28 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:28 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:09:28 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "cinder-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Lock "cinder-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "cinder-quobyte-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Lock "cinder-quobyte-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233" acquired by "delete_volume" :: waited 0.048s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:29 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.743s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:29 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:09:29 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[48837e02-72aa-4884-a739-783b244953ee]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:29 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Deleted volume successfully. Jul 21 19:09:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cc815163-e32b-41ab-a13f-6d138bcfa215 tempest-VolumesListTestJSON-2036595222 None] Lock "cinder-e8023f5b-3523-49e3-a9ec-9b9de7f594e1-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:29 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233 Jul 21 19:09:29 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:29 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233" returned: 0 in 0.504s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:30 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233 Jul 21 19:09:30 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:30 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233" returned: 0 in 0.474s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Lock "cinder-quobyte-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233" released by "delete_volume" :: held 1.089s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:30 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Created reservations ['84c8f9a6-c159-421c-b704-e0722a44092b', 'cfff7163-9617-4518-a059-e0b2c1187981', '3f498d03-391f-4014-a329-1905d29bff91', 'ac6b44a8-58e5-4320-992f-bcc5a3046352'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:09:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:30 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:09:30 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.384s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:31 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:31 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:09:31 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Deleted volume successfully. Jul 21 19:09:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-50bb20f4-cc07-453b-948c-5d7ba5d19227 tempest-VolumesListTestJSON-2036595222 None] Lock "cinder-12e6557d-cb98-4b8c-bf6c-0a1ed1cc2233-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "cinder-7af51b65-b868-4b85-a667-93d29b19104b-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Lock "cinder-7af51b65-b868-4b85-a667-93d29b19104b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "cinder-quobyte-7af51b65-b868-4b85-a667-93d29b19104b" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Lock "cinder-quobyte-7af51b65-b868-4b85-a667-93d29b19104b" acquired by "delete_volume" :: waited 0.044s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:32 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4658d1-3b6a-4f4c-b718-cb7b344d29f9]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7af51b65-b868-4b85-a667-93d29b19104b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:32 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7af51b65-b868-4b85-a667-93d29b19104b Jul 21 19:09:32 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:32 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7af51b65-b868-4b85-a667-93d29b19104b" returned: 0 in 0.713s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7af51b65-b868-4b85-a667-93d29b19104b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:32 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7af51b65-b868-4b85-a667-93d29b19104b Jul 21 19:09:32 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:33 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7af51b65-b868-4b85-a667-93d29b19104b" returned: 0 in 0.390s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Lock "cinder-quobyte-7af51b65-b868-4b85-a667-93d29b19104b" released by "delete_volume" :: held 1.176s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:33 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Created reservations ['4cb7fbc3-33f0-4f4b-9195-4f05f720998e', 'adc908e2-bfb6-4b5f-b83d-ff5aa5d18dc8', 'edc843e8-0d8a-4980-b567-bb0dbf7ea4a1', 'de76d258-8472-4914-ab5e-d6296405e65f'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:09:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:33 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:09:33 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:33 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.319s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:33 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:09:33 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Deleted volume successfully. Jul 21 19:09:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-da47fd37-dc96-4473-a2d7-96b5a51202e1 tempest-VolumesListTestJSON-2036595222 None] Lock "cinder-7af51b65-b868-4b85-a667-93d29b19104b-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Flow 'volume_create_manager' (bb44e32e-304a-40ad-af16-e03bc44caa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d69be01-de66-4370-9756-8970a482f832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d69be01-de66-4370-9756-8970a482f832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1757965567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc33515-3528-4cff-a289-8f2f1c244811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eec446524124fb68518603f442b910c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:39Z,use_quota=True,user_id='01b242284d9d416597850119e9c840a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629bca9e-5164-4d24-9c05-426256140da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629bca9e-5164-4d24-9c05-426256140da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbd4a56-fae1-46e6-898a-cdac851b1f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbd4a56-fae1-46e6-898a-cdac851b1f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efc33515-3528-4cff-a289-8f2f1c244811', 'volume_name': 'volume-efc33515-3528-4cff-a289-8f2f1c244811', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c6ef4d-83f0-4382-a8f3-808bde215e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c6ef4d-83f0-4382-a8f3-808bde215e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f689fd98-af96-4583-9b51-ac9298b0129d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:38 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Volume efc33515-3528-4cff-a289-8f2f1c244811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efc33515-3528-4cff-a289-8f2f1c244811', 'volume_size': 1} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1757965567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc33515-3528-4cff-a289-8f2f1c244811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eec446524124fb68518603f442b910c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:39Z,use_quota=True,user_id='01b242284d9d416597850119e9c840a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Creating volume efc33515-3528-4cff-a289-8f2f1c244811 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:09:38 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:09:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-efc33515-3528-4cff-a289-8f2f1c244811 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:38 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-efc33515-3528-4cff-a289-8f2f1c244811 1073741824 Jul 21 19:09:38 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:39 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-efc33515-3528-4cff-a289-8f2f1c244811 1073741824" returned: 0 in 1.195s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-efc33515-3528-4cff-a289-8f2f1c244811 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:40 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-efc33515-3528-4cff-a289-8f2f1c244811 Jul 21 19:09:40 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:40 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-efc33515-3528-4cff-a289-8f2f1c244811" returned: 0 in 0.439s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f689fd98-af96-4583-9b51-ac9298b0129d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc33515-3528-4cff-a289-8f2f1c244811', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d923090d-0a9d-42da-b5b3-6575d9c0b2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:40 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Volume volume-efc33515-3528-4cff-a289-8f2f1c244811 (efc33515-3528-4cff-a289-8f2f1c244811): created successfully Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d923090d-0a9d-42da-b5b3-6575d9c0b2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Flow 'volume_create_manager' (bb44e32e-304a-40ad-af16-e03bc44caa74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:40 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-66a54082-1556-4b98-b349-08435b489a89 tempest-VolumesNegativeTest-667300753 None] Created volume successfully. Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:40 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:09:40 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:41 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.472s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:41 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:09:41 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:09:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:09:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Flow 'volume_create_manager' (ad616130-5661-4a22-a66c-8fe3a87e9fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d972b27c-5e76-4615-8cbe-24cc436f52d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d972b27c-5e76-4615-8cbe-24cc436f52d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1280743992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4018b007-a9cf-473f-ae83-2ba76ad0c499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d226895ffbdc459d95272090eadd3d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:45Z,use_quota=True,user_id='093d179bef7d45ad8cc6b488c17238bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0542c1ab-1280-4dd6-813b-c661ebb5877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0542c1ab-1280-4dd6-813b-c661ebb5877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95cddc7-08a5-43f7-986b-48e3479e15ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95cddc7-08a5-43f7-986b-48e3479e15ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4018b007-a9cf-473f-ae83-2ba76ad0c499', 'volume_name': 'volume-4018b007-a9cf-473f-ae83-2ba76ad0c499', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78da235d-7ef5-4462-83fd-6de4181eeece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78da235d-7ef5-4462-83fd-6de4181eeece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71363d3-4e09-4162-b81a-6ad67bc08ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:45 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Volume 4018b007-a9cf-473f-ae83-2ba76ad0c499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4018b007-a9cf-473f-ae83-2ba76ad0c499', 'volume_size': 1} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1280743992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4018b007-a9cf-473f-ae83-2ba76ad0c499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d226895ffbdc459d95272090eadd3d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:45Z,use_quota=True,user_id='093d179bef7d45ad8cc6b488c17238bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Creating volume 4018b007-a9cf-473f-ae83-2ba76ad0c499 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:09:45 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:09:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4018b007-a9cf-473f-ae83-2ba76ad0c499 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:45 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4018b007-a9cf-473f-ae83-2ba76ad0c499 1073741824 Jul 21 19:09:45 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:45 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4018b007-a9cf-473f-ae83-2ba76ad0c499 1073741824" returned: 0 in 0.580s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4018b007-a9cf-473f-ae83-2ba76ad0c499 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:46 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4018b007-a9cf-473f-ae83-2ba76ad0c499 Jul 21 19:09:46 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:46 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4018b007-a9cf-473f-ae83-2ba76ad0c499" returned: 0 in 0.273s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:09:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:46 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71363d3-4e09-4162-b81a-6ad67bc08ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4018b007-a9cf-473f-ae83-2ba76ad0c499', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:46 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ae48db-6103-4768-a051-d774a8743e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:46 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Volume volume-4018b007-a9cf-473f-ae83-2ba76ad0c499 (4018b007-a9cf-473f-ae83-2ba76ad0c499): created successfully Jul 21 19:09:46 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ae48db-6103-4768-a051-d774a8743e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:46 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Flow 'volume_create_manager' (ad616130-5661-4a22-a66c-8fe3a87e9fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:46 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ed176909-4972-4ef0-9dc6-387dbe698972 tempest-TestMinimumBasicScenario-804650043 None] Created volume successfully. Jul 21 19:09:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-ec03cc52-a697-4683-b166-f0e39efb0320 req-d9d10ab7-6f71-4415-9bc9-b8867661b8a8 tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-ec03cc52-a697-4683-b166-f0e39efb0320 req-d9d10ab7-6f71-4415-9bc9-b8867661b8a8 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-ec03cc52-a697-4683-b166-f0e39efb0320 req-d9d10ab7-6f71-4415-9bc9-b8867661b8a8 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.089s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-ec03cc52-a697-4683-b166-f0e39efb0320 req-d9d10ab7-6f71-4415-9bc9-b8867661b8a8 tempest-TestInstancesWithCinderVolumes-1776198903 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6b797d9-585e-42e3-9b0c-42ab8b45a38f', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:09:48 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-ec03cc52-a697-4683-b166-f0e39efb0320 req-d9d10ab7-6f71-4415-9bc9-b8867661b8a8 tempest-TestInstancesWithCinderVolumes-1776198903 None] attachment_update completed successfully. Jul 21 19:09:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-1b11880c-40ac-4b62-ace5-5925f09030d7 req-2ff7d6b6-a862-40bc-8b14-56cbb65aa8a2 tempest-TestMinimumBasicScenario-804650043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-1b11880c-40ac-4b62-ace5-5925f09030d7 req-2ff7d6b6-a862-40bc-8b14-56cbb65aa8a2 tempest-TestMinimumBasicScenario-804650043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-1b11880c-40ac-4b62-ace5-5925f09030d7 req-2ff7d6b6-a862-40bc-8b14-56cbb65aa8a2 tempest-TestMinimumBasicScenario-804650043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.084s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-1b11880c-40ac-4b62-ace5-5925f09030d7 req-2ff7d6b6-a862-40bc-8b14-56cbb65aa8a2 tempest-TestMinimumBasicScenario-804650043 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-4018b007-a9cf-473f-ae83-2ba76ad0c499', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2797453-420b-4488-971b-df42ac5126f3', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:09:50 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-1b11880c-40ac-4b62-ace5-5925f09030d7 req-2ff7d6b6-a862-40bc-8b14-56cbb65aa8a2 tempest-TestMinimumBasicScenario-804650043 None] attachment_update completed successfully. Jul 21 19:09:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-16ca2a2e-7bce-4d85-a1e5-6953818fcba4 req-8adbe37d-d898-4b1a-8430-9630c37a44e8 tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-16ca2a2e-7bce-4d85-a1e5-6953818fcba4 req-8adbe37d-d898-4b1a-8430-9630c37a44e8 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-16ca2a2e-7bce-4d85-a1e5-6953818fcba4 req-8adbe37d-d898-4b1a-8430-9630c37a44e8 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-16ca2a2e-7bce-4d85-a1e5-6953818fcba4 req-8adbe37d-d898-4b1a-8430-9630c37a44e8 tempest-TestInstancesWithCinderVolumes-1776198903 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-6f34d682-688c-4dfa-99b6-04a804a191fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc4ee7b9-7b2c-400a-8f83-8c684469fd15', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:09:52 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-16ca2a2e-7bce-4d85-a1e5-6953818fcba4 req-8adbe37d-d898-4b1a-8430-9630c37a44e8 tempest-TestInstancesWithCinderVolumes-1776198903 None] attachment_update completed successfully. Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Flow 'volume_create_manager' (3763ffb8-36f0-4c47-89ee-f4642dae04de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe8474f-d2f6-43a7-a554-b4b13f6d94ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe8474f-d2f6-43a7-a554-b4b13f6d94ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2038018029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cb9aed-970a-4f6a-abba-51b8cd72777c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86a6dc3f65e4d43823677d07a6a90aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:54Z,use_quota=True,user_id='d2075424a3c647219a2480926a955dee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eea842e-97eb-4274-84f9-7c65a06ab51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eea842e-97eb-4274-84f9-7c65a06ab51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bd22a6-f4c1-4238-ab3e-eccba286bf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bd22a6-f4c1-4238-ab3e-eccba286bf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45cb9aed-970a-4f6a-abba-51b8cd72777c', 'volume_name': 'volume-45cb9aed-970a-4f6a-abba-51b8cd72777c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef380035-164c-4691-8ded-caa57b7522cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef380035-164c-4691-8ded-caa57b7522cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff27cc3b-eb16-4b5c-b25b-7a4b265be27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:54 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Volume 45cb9aed-970a-4f6a-abba-51b8cd72777c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45cb9aed-970a-4f6a-abba-51b8cd72777c', 'volume_size': 1} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2038018029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cb9aed-970a-4f6a-abba-51b8cd72777c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86a6dc3f65e4d43823677d07a6a90aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:54Z,use_quota=True,user_id='d2075424a3c647219a2480926a955dee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Creating volume 45cb9aed-970a-4f6a-abba-51b8cd72777c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:09:54 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:09:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-45cb9aed-970a-4f6a-abba-51b8cd72777c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:54 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-45cb9aed-970a-4f6a-abba-51b8cd72777c 1073741824 Jul 21 19:09:54 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:55 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-45cb9aed-970a-4f6a-abba-51b8cd72777c 1073741824" returned: 0 in 0.710s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-45cb9aed-970a-4f6a-abba-51b8cd72777c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:55 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-45cb9aed-970a-4f6a-abba-51b8cd72777c Jul 21 19:09:55 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:55 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-45cb9aed-970a-4f6a-abba-51b8cd72777c" returned: 0 in 0.424s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:09:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff27cc3b-eb16-4b5c-b25b-7a4b265be27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45cb9aed-970a-4f6a-abba-51b8cd72777c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95b4800-14dd-48ae-b466-a03643e75070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:56 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Volume volume-45cb9aed-970a-4f6a-abba-51b8cd72777c (45cb9aed-970a-4f6a-abba-51b8cd72777c): created successfully Jul 21 19:09:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95b4800-14dd-48ae-b466-a03643e75070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Flow 'volume_create_manager' (3763ffb8-36f0-4c47-89ee-f4642dae04de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:56 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3cd99760-6999-4101-8126-378e1042d91b tempest-AttachVolumeTestJSON-624060388 None] Created volume successfully. Jul 21 19:09:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-dfca6ed4-1df4-41ae-8ff8-dcc41721dc92 req-443cf9d2-81e6-4733-b746-54669e3de2c0 tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-dfca6ed4-1df4-41ae-8ff8-dcc41721dc92 req-443cf9d2-81e6-4733-b746-54669e3de2c0 tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-dfca6ed4-1df4-41ae-8ff8-dcc41721dc92 req-443cf9d2-81e6-4733-b746-54669e3de2c0 tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.072s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-dfca6ed4-1df4-41ae-8ff8-dcc41721dc92 req-443cf9d2-81e6-4733-b746-54669e3de2c0 tempest-AttachVolumeTestJSON-624060388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-45cb9aed-970a-4f6a-abba-51b8cd72777c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '007e233d-7da0-446d-a801-80092aa7db1b', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:09:57 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-dfca6ed4-1df4-41ae-8ff8-dcc41721dc92 req-443cf9d2-81e6-4733-b746-54669e3de2c0 tempest-AttachVolumeTestJSON-624060388 None] attachment_update completed successfully. Jul 21 19:10:00 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-efe81b85-b2af-4401-9d06-cfc29bfef21d req-829fdbf7-9327-46fd-a954-9b939b1efb81 tempest-TestInstancesWithCinderVolumes-1776198903 None] Terminate volume connection completed successfully. Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-efe81b85-b2af-4401-9d06-cfc29bfef21d req-829fdbf7-9327-46fd-a954-9b939b1efb81 tempest-TestInstancesWithCinderVolumes-1776198903 None] Deleting attachment d6b797d9-585e-42e3-9b0c-42ab8b45a38f. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Flow 'volume_create_manager' (f35df70f-df17-4daf-b8dd-8075198e58c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c425560-41df-46f5-8b89-754150fe876c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c425560-41df-46f5-8b89-754150fe876c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-375707580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72168f3-9d80-46e3-9d76-012370b64b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86a6dc3f65e4d43823677d07a6a90aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:00Z,use_quota=True,user_id='d2075424a3c647219a2480926a955dee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513e19c3-c85e-43ba-ae23-3147b3097345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513e19c3-c85e-43ba-ae23-3147b3097345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fff607-6999-453a-9ec8-2c1eea7af9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fff607-6999-453a-9ec8-2c1eea7af9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e72168f3-9d80-46e3-9d76-012370b64b9e', 'volume_name': 'volume-e72168f3-9d80-46e3-9d76-012370b64b9e', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73dfddf7-c9ac-40ad-83a8-2f9e0b0ee065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73dfddf7-c9ac-40ad-83a8-2f9e0b0ee065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4fe7e2-d964-4056-acee-15bdeec3d3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:00 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Volume e72168f3-9d80-46e3-9d76-012370b64b9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e72168f3-9d80-46e3-9d76-012370b64b9e', 'volume_size': 1} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-375707580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72168f3-9d80-46e3-9d76-012370b64b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86a6dc3f65e4d43823677d07a6a90aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:00Z,use_quota=True,user_id='d2075424a3c647219a2480926a955dee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Creating volume e72168f3-9d80-46e3-9d76-012370b64b9e {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:00 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e72168f3-9d80-46e3-9d76-012370b64b9e 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:00 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e72168f3-9d80-46e3-9d76-012370b64b9e 1073741824 Jul 21 19:10:00 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "cinder-e8268f55-dfe2-4a11-b8b8-5568d3832b58-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "cinder-e8268f55-dfe2-4a11-b8b8-5568d3832b58-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "cinder-quobyte-e8268f55-dfe2-4a11-b8b8-5568d3832b58" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "cinder-quobyte-e8268f55-dfe2-4a11-b8b8-5568d3832b58" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c373f0-1bf5-47bc-9bea-6428f217cad6]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:00 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58 Jul 21 19:10:00 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:01 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e72168f3-9d80-46e3-9d76-012370b64b9e 1073741824" returned: 0 in 0.592s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e72168f3-9d80-46e3-9d76-012370b64b9e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:01 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e72168f3-9d80-46e3-9d76-012370b64b9e Jul 21 19:10:01 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:01 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58" returned: 0 in 0.561s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:01 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58 Jul 21 19:10:01 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:01 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e72168f3-9d80-46e3-9d76-012370b64b9e" returned: 0 in 0.371s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4fe7e2-d964-4056-acee-15bdeec3d3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72168f3-9d80-46e3-9d76-012370b64b9e', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860fd2f1-e7e1-4ff2-a5a6-bec9b15a1c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:01 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Volume volume-e72168f3-9d80-46e3-9d76-012370b64b9e (e72168f3-9d80-46e3-9d76-012370b64b9e): created successfully Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860fd2f1-e7e1-4ff2-a5a6-bec9b15a1c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Flow 'volume_create_manager' (f35df70f-df17-4daf-b8dd-8075198e58c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:01 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-28f594ad-f7b8-4e68-9ba5-0238a433cdd5 tempest-AttachVolumeTestJSON-624060388 None] Created volume successfully. Jul 21 19:10:01 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8268f55-dfe2-4a11-b8b8-5568d3832b58" returned: 0 in 0.345s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "cinder-quobyte-e8268f55-dfe2-4a11-b8b8-5568d3832b58" released by "delete_volume" :: held 0.951s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:01 devstack cinder-volume[87487]: WARNING cinder.quota [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-318186934-1840350804 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-318186934-1840350804, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:10:01 devstack cinder-volume[87487]: WARNING cinder.quota [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-318186934-1840350804 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-318186934-1840350804, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Created reservations ['0201578c-e082-4525-ab64-d04b1e08cc24', '03088e22-1b4d-4bfd-9575-fe8308829ce4', '1fa6aff6-9fb0-47e9-be06-69adf3de13a4', 'd4d77491-9854-4740-83b7-db8f29d02795'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:01 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:01 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:02 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.296s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:02 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:02 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Deleted volume successfully. Jul 21 19:10:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5da1927c-26f4-4686-be7f-9a427ef98052 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "cinder-e8268f55-dfe2-4a11-b8b8-5568d3832b58-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-329a81eb-4329-4edf-8720-3fcec1758129 req-fe4d0d9a-f163-4be0-b16e-efb8d6abf40f tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-329a81eb-4329-4edf-8720-3fcec1758129 req-fe4d0d9a-f163-4be0-b16e-efb8d6abf40f tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-329a81eb-4329-4edf-8720-3fcec1758129 req-fe4d0d9a-f163-4be0-b16e-efb8d6abf40f tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:03 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-329a81eb-4329-4edf-8720-3fcec1758129 req-fe4d0d9a-f163-4be0-b16e-efb8d6abf40f tempest-AttachVolumeTestJSON-624060388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-e72168f3-9d80-46e3-9d76-012370b64b9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c43f3b8b-4cc4-4f2d-9c01-ba04b7119bef', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:10:03 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-329a81eb-4329-4edf-8720-3fcec1758129 req-fe4d0d9a-f163-4be0-b16e-efb8d6abf40f tempest-AttachVolumeTestJSON-624060388 None] attachment_update completed successfully. Jul 21 19:10:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-2583dd8b-8fbf-4148-b879-ea48c97a626b req-f123cbfa-a4cc-42b5-93e1-0da58878974a tempest-TestInstancesWithCinderVolumes-1776198903 None] Terminate volume connection completed successfully. Jul 21 19:10:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-2583dd8b-8fbf-4148-b879-ea48c97a626b req-f123cbfa-a4cc-42b5-93e1-0da58878974a tempest-TestInstancesWithCinderVolumes-1776198903 None] Deleting attachment fc4ee7b9-7b2c-400a-8f83-8c684469fd15. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:10:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Acquiring lock "cinder-efc33515-3528-4cff-a289-8f2f1c244811-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Lock "cinder-efc33515-3528-4cff-a289-8f2f1c244811-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Acquiring lock "cinder-quobyte-efc33515-3528-4cff-a289-8f2f1c244811" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Lock "cinder-quobyte-efc33515-3528-4cff-a289-8f2f1c244811" acquired by "delete_volume" :: waited 0.040s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:05 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d69d57-927e-4230-851d-d5938180ce18]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-efc33515-3528-4cff-a289-8f2f1c244811 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-003d59fe-c885-45f6-9934-e4c174ef8cfe req-30a9fbe2-4daa-47da-836a-ae8e648b58ad tempest-AttachVolumeTestJSON-624060388 None] Terminate volume connection completed successfully. Jul 21 19:10:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-003d59fe-c885-45f6-9934-e4c174ef8cfe req-30a9fbe2-4daa-47da-836a-ae8e648b58ad tempest-AttachVolumeTestJSON-624060388 None] Deleting attachment 007e233d-7da0-446d-a801-80092aa7db1b. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:10:05 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-efc33515-3528-4cff-a289-8f2f1c244811 Jul 21 19:10:05 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:05 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-efc33515-3528-4cff-a289-8f2f1c244811" returned: 0 in 0.424s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-efc33515-3528-4cff-a289-8f2f1c244811 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:05 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-efc33515-3528-4cff-a289-8f2f1c244811 Jul 21 19:10:05 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "cinder-6f34d682-688c-4dfa-99b6-04a804a191fc-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "cinder-6f34d682-688c-4dfa-99b6-04a804a191fc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "cinder-quobyte-6f34d682-688c-4dfa-99b6-04a804a191fc" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "cinder-quobyte-6f34d682-688c-4dfa-99b6-04a804a191fc" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d45dea-2093-40b3-a68b-f5fe90a989fb]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f34d682-688c-4dfa-99b6-04a804a191fc {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:06 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f34d682-688c-4dfa-99b6-04a804a191fc Jul 21 19:10:06 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-efc33515-3528-4cff-a289-8f2f1c244811" returned: 0 in 0.366s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:06 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Lock "cinder-quobyte-efc33515-3528-4cff-a289-8f2f1c244811" released by "delete_volume" :: held 0.870s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Created reservations ['53b64986-fa56-4582-b1c3-237af381b7ac', '01f3a3e8-ae73-423f-ab7d-09cf91d5b3de', '5ea8bc08-a32a-4334-8eb5-c7ad7ccdff03', 'b294dfc4-9d83-475f-ba4d-0cc004cc735e'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:06 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:06 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:06 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f34d682-688c-4dfa-99b6-04a804a191fc" returned: 0 in 0.600s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f34d682-688c-4dfa-99b6-04a804a191fc {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:06 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f34d682-688c-4dfa-99b6-04a804a191fc Jul 21 19:10:06 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:06 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.483s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:06 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:06 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Deleted volume successfully. Jul 21 19:10:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-773a79e0-da10-4eea-b711-dd5d9312db35 tempest-VolumesNegativeTest-667300753 None] Lock "cinder-efc33515-3528-4cff-a289-8f2f1c244811-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:07 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f34d682-688c-4dfa-99b6-04a804a191fc" returned: 0 in 0.488s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "cinder-quobyte-6f34d682-688c-4dfa-99b6-04a804a191fc" released by "delete_volume" :: held 1.145s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:07 devstack cinder-volume[87487]: WARNING cinder.quota [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1026653093-120386667 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1026653093-120386667, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:10:07 devstack cinder-volume[87487]: WARNING cinder.quota [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1026653093-120386667 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1026653093-120386667, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:10:07 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-c7615169-f396-4374-bdb9-c1e85bc5f27f req-ac8c6d46-024a-4ca5-8141-6b93253f1ac1 tempest-AttachVolumeTestJSON-624060388 None] Terminate volume connection completed successfully. Jul 21 19:10:07 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-c7615169-f396-4374-bdb9-c1e85bc5f27f req-ac8c6d46-024a-4ca5-8141-6b93253f1ac1 tempest-AttachVolumeTestJSON-624060388 None] Deleting attachment c43f3b8b-4cc4-4f2d-9c01-ba04b7119bef. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:10:07 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Created reservations ['03ac0a09-191c-4a50-abea-c4da2d784c74', '44ee9a6a-a8ff-432c-99db-42608e95cdb8', '2934b7f9-e736-483d-8d81-18b70948de5b', '6e23b2a1-f259-4302-90c6-38686f81f2eb'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:07 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:07 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:07 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:07 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:07 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.312s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:07 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:07 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Deleted volume successfully. Jul 21 19:10:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ffbc7e63-96da-4953-a94b-bf94e9b29f9d tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "cinder-6f34d682-688c-4dfa-99b6-04a804a191fc-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:11 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-3300629c-db94-47ca-8a77-c52613487aa7 req-4ec391d8-2636-4d2a-a9db-3cb6a7f43a60 tempest-TestInstancesWithCinderVolumes-1776198903 None] Terminate volume connection completed successfully. Jul 21 19:10:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-3300629c-db94-47ca-8a77-c52613487aa7 req-4ec391d8-2636-4d2a-a9db-3cb6a7f43a60 tempest-TestInstancesWithCinderVolumes-1776198903 None] Deleting attachment 5b5465f1-4cda-4525-ae6c-910ec04a4ae1. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:10:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "cinder-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "cinder-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:13 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=82,cinder:INSERT=14,cinder:UPDATE=77,cinder:DELETE=6 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:10:13 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:UPDATE=76,cinder:SELECT=81,cinder:INSERT=17,cinder:DELETE=7 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:10:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "cinder-quobyte-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "cinder-quobyte-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6" acquired by "delete_volume" :: waited 0.029s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:13 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b791eb2b-2aa5-43e5-8919-65f73f734702]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:14 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 Jul 21 19:10:14 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "cinder-e72168f3-9d80-46e3-9d76-012370b64b9e-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Lock "cinder-e72168f3-9d80-46e3-9d76-012370b64b9e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "cinder-quobyte-e72168f3-9d80-46e3-9d76-012370b64b9e" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Lock "cinder-quobyte-e72168f3-9d80-46e3-9d76-012370b64b9e" acquired by "delete_volume" :: waited 0.041s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:14 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbacd2e-c3a1-461f-8a31-0d54dfeaa522]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e72168f3-9d80-46e3-9d76-012370b64b9e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:14 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e72168f3-9d80-46e3-9d76-012370b64b9e Jul 21 19:10:14 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:14 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6" returned: 0 in 0.792s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:14 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6 Jul 21 19:10:14 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:15 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6" returned: 0 in 0.386s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "cinder-quobyte-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6" released by "delete_volume" :: held 1.265s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:15 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e72168f3-9d80-46e3-9d76-012370b64b9e" returned: 0 in 0.631s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e72168f3-9d80-46e3-9d76-012370b64b9e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:15 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e72168f3-9d80-46e3-9d76-012370b64b9e Jul 21 19:10:15 devstack cinder-volume[87487]: WARNING cinder.quota [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2020887643-196011829 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2020887643-196011829, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:10:15 devstack cinder-volume[87487]: WARNING cinder.quota [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2020887643-196011829 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2020887643-196011829, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:10:15 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Created reservations ['d00c6ce5-7b6a-4e9d-83d1-6e2efe834f63', '8abeeeec-90dc-4009-b20b-8d3990b5063b', '8570509b-a894-4d37-a71f-377d5d32210b', '9563baf2-dbd1-4769-bd58-27fb0d066342'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:15 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:15 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:15 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e72168f3-9d80-46e3-9d76-012370b64b9e" returned: 0 in 0.423s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Lock "cinder-quobyte-e72168f3-9d80-46e3-9d76-012370b64b9e" released by "delete_volume" :: held 1.141s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Created reservations ['9a5cdda9-2834-4a30-bae0-7993441fd491', '24a43bea-db68-4406-96e5-327e301b8765', '15394964-fd94-4e53-a8f7-5140774767e4', '7434b0db-5571-4ff7-827a-6a13bf1871a2'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:15 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:15 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:15 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.374s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:15 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Deleted volume successfully. Jul 21 19:10:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9c30e6e4-38e8-463a-a4ec-5ddd0a65f315 tempest-TestInstancesWithCinderVolumes-1776198903 None] Lock "cinder-5a9e7dce-5f55-4a6b-9927-3a58b72b1ab6-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:16 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.294s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:16 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:16 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Deleted volume successfully. Jul 21 19:10:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fdab042e-8650-4cfd-8d26-45699254004d tempest-AttachVolumeTestJSON-624060388 None] Lock "cinder-e72168f3-9d80-46e3-9d76-012370b64b9e-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "cinder-45cb9aed-970a-4f6a-abba-51b8cd72777c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Lock "cinder-45cb9aed-970a-4f6a-abba-51b8cd72777c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "cinder-quobyte-45cb9aed-970a-4f6a-abba-51b8cd72777c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Lock "cinder-quobyte-45cb9aed-970a-4f6a-abba-51b8cd72777c" acquired by "delete_volume" :: waited 0.030s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:17 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4525da-d175-40db-bf58-34e75bc417dd]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-45cb9aed-970a-4f6a-abba-51b8cd72777c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:17 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-45cb9aed-970a-4f6a-abba-51b8cd72777c Jul 21 19:10:17 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:17 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-45cb9aed-970a-4f6a-abba-51b8cd72777c" returned: 0 in 0.445s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-45cb9aed-970a-4f6a-abba-51b8cd72777c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:17 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-45cb9aed-970a-4f6a-abba-51b8cd72777c Jul 21 19:10:17 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:17 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-45cb9aed-970a-4f6a-abba-51b8cd72777c" returned: 0 in 0.264s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Lock "cinder-quobyte-45cb9aed-970a-4f6a-abba-51b8cd72777c" released by "delete_volume" :: held 0.785s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:17 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Created reservations ['6837e0fa-66bd-4cba-b199-95771fe5e330', '9941befd-0483-49f9-b592-17d130ed1301', '16b06de1-009c-4428-8992-db3d73612853', 'f008990a-8209-4c12-8fd0-513e8ccc384c'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:17 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:17 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "cinder-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Lock "cinder-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:18 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.469s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:18 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:18 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Deleted volume successfully. Jul 21 19:10:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8580c977-64b9-423a-9b61-6a4e81ff1143 tempest-AttachVolumeTestJSON-624060388 None] Lock "cinder-45cb9aed-970a-4f6a-abba-51b8cd72777c-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "cinder-quobyte-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Lock "cinder-quobyte-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:18 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[800c1b4e-0535-49cb-8d61-b81c4337d0b9]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:18 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff Jul 21 19:10:18 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:18 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff" returned: 0 in 0.423s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:18 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff Jul 21 19:10:18 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:19 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff" returned: 0 in 0.391s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Lock "cinder-quobyte-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff" released by "delete_volume" :: held 0.872s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:19 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Created reservations ['0d6e5470-dd0f-4a2e-b667-87f6f4cfbb63', '2660cf73-3f3a-4a27-8a82-0640139bb0a0', 'aea6cc83-44e6-4882-bd3d-dbe14562bd6a', '5d22e25d-d990-47b1-abf0-35321ffb5dd3'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:19 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:19 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:19 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.332s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:19 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:19 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Deleted volume successfully. Jul 21 19:10:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-d135a0fd-e0d1-41a4-8c3a-c46c61412513 tempest-AttachVolumeTestJSON-624060388 None] Lock "cinder-fc79f66e-e0bb-4ed4-9d5b-5f04e58e57ff-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Flow 'volume_create_manager' (23233b9d-44aa-49bf-b6d7-cbbcd9ffa170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da381111-c33c-4d46-bd95-f69c79d28414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da381111-c33c-4d46-bd95-f69c79d28414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-33915241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6df8d0ec6548a6b0d0dfcb954c520e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:25Z,use_quota=True,user_id='1e43beaa592b452fba0353e966593016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1241e4-868f-4276-b662-871d9922e9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1241e4-868f-4276-b662-871d9922e9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616c9e18-a7c7-4748-a2da-91b122911fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616c9e18-a7c7-4748-a2da-91b122911fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4', 'volume_name': 'volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0723141a-73b8-489b-babd-bbe6efd41635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0723141a-73b8-489b-babd-bbe6efd41635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed22d437-9ea9-49ea-87f6-c408dd676997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:25 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Volume b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4', 'volume_size': 1} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-33915241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6df8d0ec6548a6b0d0dfcb954c520e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:25Z,use_quota=True,user_id='1e43beaa592b452fba0353e966593016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Creating volume b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:25 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:10:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:25 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 1073741824 Jul 21 19:10:25 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:26 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 1073741824" returned: 0 in 0.935s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:26 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 Jul 21 19:10:26 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:26 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4" returned: 0 in 0.317s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed22d437-9ea9-49ea-87f6-c408dd676997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44eba66-a3fd-4986-8a55-f2d1548207c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:26 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Volume volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 (b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4): created successfully Jul 21 19:10:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44eba66-a3fd-4986-8a55-f2d1548207c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Flow 'volume_create_manager' (23233b9d-44aa-49bf-b6d7-cbbcd9ffa170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:26 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-e2e02385-1fb5-4ed6-b3c0-036f31745ac6 tempest-VolumesSnapshotTestJSON-380021827 None] Created volume successfully. Jul 21 19:10:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] Creating offline snapshot 1bfba78e-e6d5-4590-aa58-b7666ca8715d of volume b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:10:27 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd2175a-5d34-4445-8082-0db41a59b489]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:27 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 Jul 21 19:10:27 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:27 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4" returned: 0 in 0.422s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:27 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d 1G Jul 21 19:10:27 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:28 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d 1G" returned: 0 in 0.526s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:28 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d Jul 21 19:10:28 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:28 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d" returned: 0 in 0.369s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:28 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d is being set with open permissions: ugo+rw Jul 21 19:10:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:28 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d Jul 21 19:10:28 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:29 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d" returned: 0 in 0.339s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:29 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.info Jul 21 19:10:29 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:29 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.info" returned: 0 in 0.288s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:29 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.info is being set with open permissions: ugo+rw Jul 21 19:10:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:29 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.info Jul 21 19:10:29 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:29 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.info" returned: 0 in 0.323s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:29 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3f0d7e95-c453-4430-bb47-e3a7a6bad37b tempest-VolumesSnapshotTestJSON-380021827 None] Create snapshot completed successfully Jul 21 19:10:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-1bfba78e-e6d5-4590-aa58-b7666ca8715d-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-1bfba78e-e6d5-4590-aa58-b7666ca8715d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-1bfba78e-e6d5-4590-aa58-b7666ca8715d" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-1bfba78e-e6d5-4590-aa58-b7666ca8715d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:31 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Deleting offline snapshot 1bfba78e-e6d5-4590-aa58-b7666ca8715d of volume b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:10:31 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] snapshot_file for this snap is: volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:10:31 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fca264-8f95-4bb6-873b-69a4631fec36]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:31 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d Jul 21 19:10:31 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:31 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d" returned: 0 in 0.413s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:31 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:10:31 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c6fcf2-f675-4bb8-be0b-4203773754ab]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:31 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 Jul 21 19:10:31 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:31 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4" returned: 0 in 0.424s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:31 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d Jul 21 19:10:31 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:32 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d" returned: 0 in 0.435s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:32 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d Jul 21 19:10:32 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:32 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4.1bfba78e-e6d5-4590-aa58-b7666ca8715d" returned: 0 in 0.280s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-1bfba78e-e6d5-4590-aa58-b7666ca8715d" released by "_delete_snapshot" :: held 1.721s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4" released by "delete_snapshot" :: held 1.750s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:32 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Created reservations ['5bf2192c-78d9-4920-9de1-9f36da5e6fe9', '36272e14-8f20-41b3-998b-631b15052dfc', '8baaee56-eec0-4feb-9419-d5b28d6ceb8f', 'e020796d-84e2-4658-a7a0-3a011ebef92c'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:32 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Delete snapshot completed successfully. Jul 21 19:10:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d71caa9-ac84-4ae2-8f8b-2d5abbea1748 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-1bfba78e-e6d5-4590-aa58-b7666ca8715d-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:33 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Flow 'volume_create_manager' (6a4fe2f1-0c51-44cf-a3db-480b6acee8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8c7cf6-6935-41c3-9896-60fde2fce6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8c7cf6-6935-41c3-9896-60fde2fce6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-188150825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1b607c-4bab-4de7-ba16-1206d81c65ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6df8d0ec6548a6b0d0dfcb954c520e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:34Z,use_quota=True,user_id='1e43beaa592b452fba0353e966593016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28afd3f6-07c9-4c64-aa7f-5fe014a88a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28afd3f6-07c9-4c64-aa7f-5fe014a88a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f875252-f199-4043-a163-464f3667da62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f875252-f199-4043-a163-464f3667da62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1b607c-4bab-4de7-ba16-1206d81c65ef', 'volume_name': 'volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e329f5-687e-4f4a-bbfb-0ced4bdcd79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e329f5-687e-4f4a-bbfb-0ced4bdcd79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36dbc16-dbf7-4185-8e9c-a449dea8cda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:34 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Volume bb1b607c-4bab-4de7-ba16-1206d81c65ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef', 'volume_size': 1} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-188150825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1b607c-4bab-4de7-ba16-1206d81c65ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6df8d0ec6548a6b0d0dfcb954c520e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:34Z,use_quota=True,user_id='1e43beaa592b452fba0353e966593016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Creating volume bb1b607c-4bab-4de7-ba16-1206d81c65ef {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:34 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:34 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef 1073741824 Jul 21 19:10:34 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:34 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef 1073741824" returned: 0 in 0.635s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:34 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef Jul 21 19:10:34 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Flow 'volume_create_manager' (c1ac7aae-4765-4bcc-89c0-7d83b26e4b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc81217b-cf60-4916-b3a9-c7e1cfc686c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc81217b-cf60-4916-b3a9-c7e1cfc686c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1450297648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168a14c7-27f2-4653-931e-93b84ca77090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401f866f59c54b2ab2686392385a9b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:35Z,use_quota=True,user_id='2a052c01c140462e88bbe54ee090f92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce33581e-299c-4609-aa8d-9625810b3286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce33581e-299c-4609-aa8d-9625810b3286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20bb6f86-ef45-43df-89a2-c4b4e4506c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20bb6f86-ef45-43df-89a2-c4b4e4506c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '168a14c7-27f2-4653-931e-93b84ca77090', 'volume_name': 'volume-168a14c7-27f2-4653-931e-93b84ca77090', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6b2c88-742b-4495-bbcf-dba096d9ff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6b2c88-742b-4495-bbcf-dba096d9ff18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7694094c-b2f5-46a6-817b-c4f9528af6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:34 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume 168a14c7-27f2-4653-931e-93b84ca77090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-168a14c7-27f2-4653-931e-93b84ca77090', 'volume_size': 1} Jul 21 19:10:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:35 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef" returned: 0 in 0.351s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.179s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1450297648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168a14c7-27f2-4653-931e-93b84ca77090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401f866f59c54b2ab2686392385a9b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:35Z,use_quota=True,user_id='2a052c01c140462e88bbe54ee090f92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Creating volume 168a14c7-27f2-4653-931e-93b84ca77090 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:35 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-168a14c7-27f2-4653-931e-93b84ca77090 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36dbc16-dbf7-4185-8e9c-a449dea8cda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e56caa-b179-4db6-abc1-24dd5d00b49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:35 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-168a14c7-27f2-4653-931e-93b84ca77090 1073741824 Jul 21 19:10:35 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:35 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Volume volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef (bb1b607c-4bab-4de7-ba16-1206d81c65ef): created successfully Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e56caa-b179-4db6-abc1-24dd5d00b49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Flow 'volume_create_manager' (6a4fe2f1-0c51-44cf-a3db-480b6acee8b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:35 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-192c04b8-5156-4b43-94f7-00953dc2eeef tempest-VolumesSnapshotTestJSON-380021827 None] Created volume successfully. Jul 21 19:10:35 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-168a14c7-27f2-4653-931e-93b84ca77090 1073741824" returned: 0 in 0.635s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-168a14c7-27f2-4653-931e-93b84ca77090 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:35 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-168a14c7-27f2-4653-931e-93b84ca77090 Jul 21 19:10:35 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:36 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-168a14c7-27f2-4653-931e-93b84ca77090" returned: 0 in 0.347s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7694094c-b2f5-46a6-817b-c4f9528af6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-168a14c7-27f2-4653-931e-93b84ca77090', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021f8c01-ddf3-4ae6-9be6-5ab201fd08cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:36 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume volume-168a14c7-27f2-4653-931e-93b84ca77090 (168a14c7-27f2-4653-931e-93b84ca77090): created successfully Jul 21 19:10:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021f8c01-ddf3-4ae6-9be6-5ab201fd08cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Flow 'volume_create_manager' (c1ac7aae-4765-4bcc-89c0-7d83b26e4b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:36 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-52ace0e5-0081-4ea8-ac1e-8f60d4a99525 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Created volume successfully. Jul 21 19:10:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] Creating offline snapshot 116ea520-e78f-464a-b8f3-c6aaaa36f973 of volume bb1b607c-4bab-4de7-ba16-1206d81c65ef {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:10:36 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[453c10a1-1b4d-4c92-8475-6db86a8ed725]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:36 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef Jul 21 19:10:36 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:36 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef" returned: 0 in 0.431s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:36 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 1G Jul 21 19:10:36 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:37 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 1G" returned: 0 in 0.619s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:37 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 Jul 21 19:10:37 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Flow 'volume_create_manager' (361e68b1-da88-437e-b8f0-37e90ac84fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4946bb17-ad6d-4e81-845d-691bf2723642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4946bb17-ad6d-4e81-845d-691bf2723642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1429622373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=123794ee-cd76-45e9-8820-4cb9129bcade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401f866f59c54b2ab2686392385a9b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:38Z,use_quota=True,user_id='2a052c01c140462e88bbe54ee090f92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb21d6db-5c00-440f-8901-f2edc1e3ecde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb21d6db-5c00-440f-8901-f2edc1e3ecde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d280c15-cd0f-4b87-b792-e6bd30c54ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d280c15-cd0f-4b87-b792-e6bd30c54ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '123794ee-cd76-45e9-8820-4cb9129bcade', 'volume_name': 'volume-123794ee-cd76-45e9-8820-4cb9129bcade', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b87e6c-2938-4a33-a691-35c3f0f8f6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b87e6c-2938-4a33-a691-35c3f0f8f6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54ff54b-ba08-4b7b-8eeb-6146e5fc4bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:37 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume 123794ee-cd76-45e9-8820-4cb9129bcade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-123794ee-cd76-45e9-8820-4cb9129bcade', 'volume_size': 1} Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:37 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973" returned: 0 in 0.568s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:37 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 is being set with open permissions: ugo+rw Jul 21 19:10:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:38 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 Jul 21 19:10:38 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Flow 'volume_create_manager' (405e9056-d1cd-4743-8a36-9d798960bcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa227fe-ca21-4410-aee6-fdaa69e9e911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa227fe-ca21-4410-aee6-fdaa69e9e911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1964353523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401f866f59c54b2ab2686392385a9b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:38Z,use_quota=True,user_id='2a052c01c140462e88bbe54ee090f92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c903571-5fe0-4b45-badb-44051c1af99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c903571-5fe0-4b45-badb-44051c1af99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73162650-f83b-4130-a5a8-e2330465d442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73162650-f83b-4130-a5a8-e2330465d442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb', 'volume_name': 'volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31012b7b-1a2b-4e7e-ab49-86637a0b9340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31012b7b-1a2b-4e7e-ab49-86637a0b9340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd317f2-efa3-4218-ab9e-e766041c7bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:38 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb', 'volume_size': 1} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:38 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973" returned: 0 in 0.417s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:38 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.info Jul 21 19:10:38 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Flow 'volume_create_manager' (df19cc51-5b4e-4f23-b0c7-e50fd2ed65cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f139a6-5ec9-4e6d-9349-e3d98e52959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f139a6-5ec9-4e6d-9349-e3d98e52959e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1382390311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adac59e5-0a1b-455b-9415-1efcda5933ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401f866f59c54b2ab2686392385a9b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:39Z,use_quota=True,user_id='2a052c01c140462e88bbe54ee090f92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c787fb0-8f70-4952-b7ec-5a85643106e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:38 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c787fb0-8f70-4952-b7ec-5a85643106e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7224cde5-de57-4bd0-b039-28460a694b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7224cde5-de57-4bd0-b039-28460a694b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adac59e5-0a1b-455b-9415-1efcda5933ba', 'volume_name': 'volume-adac59e5-0a1b-455b-9415-1efcda5933ba', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e609c542-6220-4a87-924e-811bdc1c72b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e609c542-6220-4a87-924e-811bdc1c72b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2cb7fb-a7dc-48e7-851f-ca5fe20d55fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:38 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume adac59e5-0a1b-455b-9415-1efcda5933ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adac59e5-0a1b-455b-9415-1efcda5933ba', 'volume_size': 1} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.info" returned: 0 in 0.524s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:38 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.info is being set with open permissions: ugo+rw Jul 21 19:10:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:39 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.info Jul 21 19:10:39 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Flow 'volume_create_manager' (f1528a5d-fbb8-49ab-b018-292bad37dd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165ae2c6-6770-4ce1-858e-c29f6fd70f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165ae2c6-6770-4ce1-858e-c29f6fd70f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-557147532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c927a4f5-8b37-4eb6-bde4-7fb03856b594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401f866f59c54b2ab2686392385a9b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:39Z,use_quota=True,user_id='2a052c01c140462e88bbe54ee090f92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fa809c-0e93-4752-bded-58e669e65e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fa809c-0e93-4752-bded-58e669e65e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b5a4c0-8dd7-4775-9f74-f55e6409e111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b5a4c0-8dd7-4775-9f74-f55e6409e111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c927a4f5-8b37-4eb6-bde4-7fb03856b594', 'volume_name': 'volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db0bab5-f796-41d1-b344-93c1f9b4583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db0bab5-f796-41d1-b344-93c1f9b4583a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:39 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d275e18b-aad7-4d9e-b4c5-ff614d7bfb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:39 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume c927a4f5-8b37-4eb6-bde4-7fb03856b594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594', 'volume_size': 1} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.info" returned: 0 in 0.318s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.607s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1429622373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=123794ee-cd76-45e9-8820-4cb9129bcade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401f866f59c54b2ab2686392385a9b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:38Z,use_quota=True,user_id='2a052c01c140462e88bbe54ee090f92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Creating volume 123794ee-cd76-45e9-8820-4cb9129bcade {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:39 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-123794ee-cd76-45e9-8820-4cb9129bcade 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:39 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-123794ee-cd76-45e9-8820-4cb9129bcade 1073741824 Jul 21 19:10:39 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:39 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d4baa4c9-5499-4c5a-981a-4d996a9fac62 tempest-VolumesSnapshotTestJSON-380021827 None] Create snapshot completed successfully Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Flow 'volume_create_manager' (217eef79-cb59-474a-a911-37200f33b243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc05828-fc07-4278-a1a2-e8fbd816114a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc05828-fc07-4278-a1a2-e8fbd816114a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359121230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958dae75-0ff8-487e-b48f-355e68fe46a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401f866f59c54b2ab2686392385a9b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:40Z,use_quota=True,user_id='2a052c01c140462e88bbe54ee090f92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d45d6a0-c8f2-4e65-84fb-45519b164061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d45d6a0-c8f2-4e65-84fb-45519b164061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c18f78-61ba-400b-8403-f8bf0a050666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c18f78-61ba-400b-8403-f8bf0a050666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '958dae75-0ff8-487e-b48f-355e68fe46a2', 'volume_name': 'volume-958dae75-0ff8-487e-b48f-355e68fe46a2', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1833561-db32-4fbc-83f4-b0838f0ee2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1833561-db32-4fbc-83f4-b0838f0ee2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2618f785-bd9d-4084-9c99-57bcdfc38125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:39 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume 958dae75-0ff8-487e-b48f-355e68fe46a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-958dae75-0ff8-487e-b48f-355e68fe46a2', 'volume_size': 1} Jul 21 19:10:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:40 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-123794ee-cd76-45e9-8820-4cb9129bcade 1073741824" returned: 0 in 0.771s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-123794ee-cd76-45e9-8820-4cb9129bcade {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:40 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-123794ee-cd76-45e9-8820-4cb9129bcade Jul 21 19:10:40 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:40 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-123794ee-cd76-45e9-8820-4cb9129bcade" returned: 0 in 0.397s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.319s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1964353523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401f866f59c54b2ab2686392385a9b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:38Z,use_quota=True,user_id='2a052c01c140462e88bbe54ee090f92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Creating volume c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:40 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:40 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb 1073741824 Jul 21 19:10:40 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Flow 'volume_create_manager' (e351455c-15c5-40d3-a00f-1a88ec5962ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:40 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:40 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ceaeb91-5494-4fd5-89ec-004e20cbb837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54ff54b-ba08-4b7b-8eeb-6146e5fc4bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-123794ee-cd76-45e9-8820-4cb9129bcade', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b092119c-37c6-415a-98b6-278b6d110fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ceaeb91-5494-4fd5-89ec-004e20cbb837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-854773834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2167a11f-2d3a-4c8c-a327-6b7726c0a82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6df8d0ec6548a6b0d0dfcb954c520e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=116ea520-e78f-464a-b8f3-c6aaaa36f973,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:40Z,use_quota=True,user_id='1e43beaa592b452fba0353e966593016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee3e7d7-f646-4632-9cb2-9b54c12d2fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee3e7d7-f646-4632-9cb2-9b54c12d2fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6292fa-4a4f-46ae-adf0-eb51c2d93304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6292fa-4a4f-46ae-adf0-eb51c2d93304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2167a11f-2d3a-4c8c-a327-6b7726c0a82d', 'volume_name': 'volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d', 'volume_size': 2, 'snapshot_id': '116ea520-e78f-464a-b8f3-c6aaaa36f973'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3d8dae-1b73-43ff-956f-b58629fc5594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3d8dae-1b73-43ff-956f-b58629fc5594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fdd810-8c89-404d-a8e5-c3c64fbae163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:40 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Volume 2167a11f-2d3a-4c8c-a327-6b7726c0a82d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d', 'volume_size': 2, 'snapshot_id': '116ea520-e78f-464a-b8f3-c6aaaa36f973'} Jul 21 19:10:40 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume volume-123794ee-cd76-45e9-8820-4cb9129bcade (123794ee-cd76-45e9-8820-4cb9129bcade): created successfully Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b092119c-37c6-415a-98b6-278b6d110fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Flow 'volume_create_manager' (361e68b1-da88-437e-b8f0-37e90ac84fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:40 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-7f15e651-c5ad-45ac-a901-cfa8ec87844a tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Created volume successfully. Jul 21 19:10:41 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.539s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:10:41 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb 1073741824" returned: 0 in 0.866s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:41 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb Jul 21 19:10:41 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:41 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-eeafa6eb-ef5a-444b-94c3-ce35be33207e req-22a02b46-2048-47ca-9671-fff3c4ea2204 tempest-TestMinimumBasicScenario-804650043 None] Terminate volume connection completed successfully. Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-eeafa6eb-ef5a-444b-94c3-ce35be33207e req-22a02b46-2048-47ca-9671-fff3c4ea2204 tempest-TestMinimumBasicScenario-804650043 None] Deleting attachment f2797453-420b-4488-971b-df42ac5126f3. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:10:41 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb" returned: 0 in 0.364s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.968s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1382390311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adac59e5-0a1b-455b-9415-1efcda5933ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401f866f59c54b2ab2686392385a9b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:39Z,use_quota=True,user_id='2a052c01c140462e88bbe54ee090f92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Creating volume adac59e5-0a1b-455b-9415-1efcda5933ba {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:41 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-adac59e5-0a1b-455b-9415-1efcda5933ba 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd317f2-efa3-4218-ab9e-e766041c7bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52065cf0-9c5f-4d74-935b-2e9ab14ef030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:41 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-adac59e5-0a1b-455b-9415-1efcda5933ba 1073741824 Jul 21 19:10:41 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:42 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb (c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb): created successfully Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52065cf0-9c5f-4d74-935b-2e9ab14ef030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Flow 'volume_create_manager' (405e9056-d1cd-4743-8a36-9d798960bcac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:42 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-65f2f9e7-e376-4d1a-a68d-51247458fc04 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Created volume successfully. Jul 21 19:10:42 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-adac59e5-0a1b-455b-9415-1efcda5933ba 1073741824" returned: 0 in 0.612s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-adac59e5-0a1b-455b-9415-1efcda5933ba {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Acquiring lock "cinder-4018b007-a9cf-473f-ae83-2ba76ad0c499-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Lock "cinder-4018b007-a9cf-473f-ae83-2ba76ad0c499-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:42 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-adac59e5-0a1b-455b-9415-1efcda5933ba Jul 21 19:10:42 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Acquiring lock "cinder-quobyte-4018b007-a9cf-473f-ae83-2ba76ad0c499" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Lock "cinder-quobyte-4018b007-a9cf-473f-ae83-2ba76ad0c499" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca3006d-7ac1-40b6-b101-f5f10625d1ed]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4018b007-a9cf-473f-ae83-2ba76ad0c499 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:42 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4018b007-a9cf-473f-ae83-2ba76ad0c499 Jul 21 19:10:42 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:42 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-adac59e5-0a1b-455b-9415-1efcda5933ba" returned: 0 in 0.273s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.589s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-557147532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c927a4f5-8b37-4eb6-bde4-7fb03856b594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401f866f59c54b2ab2686392385a9b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:39Z,use_quota=True,user_id='2a052c01c140462e88bbe54ee090f92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Creating volume c927a4f5-8b37-4eb6-bde4-7fb03856b594 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:42 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2cb7fb-a7dc-48e7-851f-ca5fe20d55fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adac59e5-0a1b-455b-9415-1efcda5933ba', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db96caf6-e0db-43d4-809f-d3720dc4a31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:42 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594 1073741824 Jul 21 19:10:42 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:42 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume volume-adac59e5-0a1b-455b-9415-1efcda5933ba (adac59e5-0a1b-455b-9415-1efcda5933ba): created successfully Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db96caf6-e0db-43d4-809f-d3720dc4a31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Flow 'volume_create_manager' (df19cc51-5b4e-4f23-b0c7-e50fd2ed65cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:42 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-949bebf3-2dc5-4044-a35e-4c6b44130149 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Created volume successfully. Jul 21 19:10:43 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4018b007-a9cf-473f-ae83-2ba76ad0c499" returned: 0 in 0.477s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4018b007-a9cf-473f-ae83-2ba76ad0c499 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:43 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4018b007-a9cf-473f-ae83-2ba76ad0c499 Jul 21 19:10:43 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:43 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594 1073741824" returned: 0 in 0.625s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:43 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4018b007-a9cf-473f-ae83-2ba76ad0c499" returned: 0 in 0.324s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Lock "cinder-quobyte-4018b007-a9cf-473f-ae83-2ba76ad0c499" released by "delete_volume" :: held 0.850s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:43 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594 Jul 21 19:10:43 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Created reservations ['e7b43775-59a3-431e-8926-46a5f89d37fe', '6f6e7ade-6c76-4508-9eaa-c011a6a66e2b', '2e7179b9-3210-4695-88d7-2cd5c93f7ea7', '214ce643-6266-4f21-8ae9-57081b3ae2ec'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:43 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:43 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:43 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594" returned: 0 in 0.397s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.038s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359121230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958dae75-0ff8-487e-b48f-355e68fe46a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401f866f59c54b2ab2686392385a9b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:40Z,use_quota=True,user_id='2a052c01c140462e88bbe54ee090f92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Creating volume 958dae75-0ff8-487e-b48f-355e68fe46a2 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:44 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:10:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-958dae75-0ff8-487e-b48f-355e68fe46a2 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d275e18b-aad7-4d9e-b4c5-ff614d7bfb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:44 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-958dae75-0ff8-487e-b48f-355e68fe46a2 1073741824 Jul 21 19:10:44 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2f036c-3f90-4a3b-9925-382a53bf179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:44 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594 (c927a4f5-8b37-4eb6-bde4-7fb03856b594): created successfully Jul 21 19:10:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2f036c-3f90-4a3b-9925-382a53bf179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Flow 'volume_create_manager' (f1528a5d-fbb8-49ab-b018-292bad37dd7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:44 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:44 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-1226d4c5-0471-4ba1-abcc-c0b23af169c6 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Created volume successfully. Jul 21 19:10:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.379s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:44 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:44 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Deleted volume successfully. Jul 21 19:10:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7b49a3d7-06fc-493d-92aa-84244582ede0 tempest-TestMinimumBasicScenario-804650043 None] Lock "cinder-4018b007-a9cf-473f-ae83-2ba76ad0c499-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:44 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-958dae75-0ff8-487e-b48f-355e68fe46a2 1073741824" returned: 0 in 0.862s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-958dae75-0ff8-487e-b48f-355e68fe46a2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:44 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-958dae75-0ff8-487e-b48f-355e68fe46a2 Jul 21 19:10:44 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:45 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-958dae75-0ff8-487e-b48f-355e68fe46a2" returned: 0 in 0.304s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.366s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-116ea520-e78f-464a-b8f3-c6aaaa36f973-2167a11f-2d3a-4c8c-a327-6b7726c0a82d" by "_create_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2618f785-bd9d-4084-9c99-57bcdfc38125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-958dae75-0ff8-487e-b48f-355e68fe46a2', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3423195-fbfc-407b-ba6e-8c7302aac68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-116ea520-e78f-464a-b8f3-c6aaaa36f973-2167a11f-2d3a-4c8c-a327-6b7726c0a82d" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Creating volume 2167a11f-2d3a-4c8c-a327-6b7726c0a82d from snapshot 116ea520-e78f-464a-b8f3-c6aaaa36f973 {{(pid=87487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-2167a11f-2d3a-4c8c-a327-6b7726c0a82d" by "_copy_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:45 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Volume volume-958dae75-0ff8-487e-b48f-355e68fe46a2 (958dae75-0ff8-487e-b48f-355e68fe46a2): created successfully Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3423195-fbfc-407b-ba6e-8c7302aac68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Flow 'volume_create_manager' (217eef79-cb59-474a-a911-37200f33b243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-2167a11f-2d3a-4c8c-a327-6b7726c0a82d" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] snapshot: 116ea520-e78f-464a-b8f3-c6aaaa36f973, volume: 2167a11f-2d3a-4c8c-a327-6b7726c0a82d, {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:45 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9c08a414-b0bb-4c73-b9a7-3b35a2cad607 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Created volume successfully. Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6b7fd8-3a34-404c-ac61-7fd4d486fe1d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:45 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 Jul 21 19:10:45 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "cinder-958dae75-0ff8-487e-b48f-355e68fe46a2-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-958dae75-0ff8-487e-b48f-355e68fe46a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "cinder-quobyte-958dae75-0ff8-487e-b48f-355e68fe46a2" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-quobyte-958dae75-0ff8-487e-b48f-355e68fe46a2" acquired by "delete_volume" :: waited 0.047s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3d6e33-03f0-4f28-85c1-1b2ebb75a289]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-958dae75-0ff8-487e-b48f-355e68fe46a2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:45 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-958dae75-0ff8-487e-b48f-355e68fe46a2 Jul 21 19:10:45 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:45 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973" returned: 0 in 0.611s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Creating direct copy from snapshot {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4428b6ad-1c05-44bd-8221-1acc45b1da6b]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:46 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef Jul 21 19:10:46 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:46 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-958dae75-0ff8-487e-b48f-355e68fe46a2" returned: 0 in 0.487s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-958dae75-0ff8-487e-b48f-355e68fe46a2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:46 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-958dae75-0ff8-487e-b48f-355e68fe46a2 Jul 21 19:10:46 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:46 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef" returned: 0 in 0.447s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG cinder.utils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Path /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d not found in is_blk_device check {{(pid=87487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:46 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d Jul 21 19:10:46 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:46 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-958dae75-0ff8-487e-b48f-355e68fe46a2" returned: 0 in 0.289s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-quobyte-958dae75-0ff8-487e-b48f-355e68fe46a2" released by "delete_volume" :: held 0.849s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Created reservations ['82c07d93-1549-4a52-abad-73e36e3eea2f', '13475d82-d5fc-4248-bace-4e2a4ffa4c19', '22d2b294-2dfe-4c8d-9f4d-58126c1b53bc', 'fcdd0d22-c123-48ef-b0bf-5eccab46c6f7'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:46 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:46 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "cinder-c927a4f5-8b37-4eb6-bde4-7fb03856b594-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-c927a4f5-8b37-4eb6-bde4-7fb03856b594-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "cinder-quobyte-c927a4f5-8b37-4eb6-bde4-7fb03856b594" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-quobyte-c927a4f5-8b37-4eb6-bde4-7fb03856b594" acquired by "delete_volume" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:47 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e639bfbd-e335-4f6d-91a8-a70d80dae92d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:47 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594 Jul 21 19:10:47 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:47 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.556s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:47 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:47 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Deleted volume successfully. Jul 21 19:10:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b27e6b38-4307-4453-a8f8-d8ee10c402a9 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-958dae75-0ff8-487e-b48f-355e68fe46a2-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:47 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594" returned: 0 in 0.808s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:47 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594 Jul 21 19:10:47 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:48 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c927a4f5-8b37-4eb6-bde4-7fb03856b594" returned: 0 in 0.730s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-quobyte-c927a4f5-8b37-4eb6-bde4-7fb03856b594" released by "delete_volume" :: held 1.631s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:48 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Created reservations ['dd1aa05a-69c2-47fd-bc3d-569ce9dbe233', '64d5678a-6778-420c-9cc1-f3406bcdf513', '2d6c4a1d-3883-4257-b648-f26b7f19b0e6', '62611ea2-9a0b-4c68-b616-9ffe78da50df'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:49 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:49 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "cinder-adac59e5-0a1b-455b-9415-1efcda5933ba-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-adac59e5-0a1b-455b-9415-1efcda5933ba-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "cinder-quobyte-adac59e5-0a1b-455b-9415-1efcda5933ba" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-quobyte-adac59e5-0a1b-455b-9415-1efcda5933ba" acquired by "delete_volume" :: waited 0.034s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:49 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaf774c-bfcc-4e90-8ddc-37291e4ec80e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-adac59e5-0a1b-455b-9415-1efcda5933ba {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:49 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.818s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:49 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:49 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Deleted volume successfully. Jul 21 19:10:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e86ab605-0f20-4bd9-b49d-fa38cbe69b73 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-c927a4f5-8b37-4eb6-bde4-7fb03856b594-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:50 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-adac59e5-0a1b-455b-9415-1efcda5933ba Jul 21 19:10:50 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:51 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-adac59e5-0a1b-455b-9415-1efcda5933ba" returned: 0 in 1.176s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-adac59e5-0a1b-455b-9415-1efcda5933ba {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:51 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-adac59e5-0a1b-455b-9415-1efcda5933ba Jul 21 19:10:51 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:51 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-adac59e5-0a1b-455b-9415-1efcda5933ba" returned: 0 in 0.377s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-quobyte-adac59e5-0a1b-455b-9415-1efcda5933ba" released by "delete_volume" :: held 1.665s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:51 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Created reservations ['cf6e3672-6760-47cb-8a70-a0db22465d4c', '14e67ba3-47a4-42ee-b17c-57e055e87f5b', 'b8c52f3b-fed5-40b5-a2ac-bad956a64be6', '6c47956d-aac3-4d40-ac3c-9125c97fbeb3'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:51 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:51 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:52 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "cinder-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.560s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:52 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:52 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Deleted volume successfully. Jul 21 19:10:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-61fa3b2f-0455-4d18-9ca6-0739b9268114 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-adac59e5-0a1b-455b-9415-1efcda5933ba-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "cinder-quobyte-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-quobyte-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb" acquired by "delete_volume" :: waited 0.033s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:52 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39f6de4-5845-4b35-9500-170c0fb9767d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:52 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb Jul 21 19:10:52 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d" returned: 0 in 6.645s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e6a5a5-6156-45be-8443-fb242d3cab0c]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:53 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef Jul 21 19:10:53 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:53 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb" returned: 0 in 0.743s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:53 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb Jul 21 19:10:53 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:53 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb" returned: 0 in 0.381s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-quobyte-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb" released by "delete_volume" :: held 1.214s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Created reservations ['a8ffbed7-520c-4579-9eaa-d74aa67dfe36', 'a52ac1e7-99e8-40a0-a2b1-9e15e5634c4e', 'ac95f556-8c33-40e3-a1be-1392060bd6d9', 'e88f1a56-b9a1-4483-9a77-989c1eb79913'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:53 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef" returned: 0 in 0.684s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:10:53 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Converted 1024.00 MB image at 154.08 MB/s Jul 21 19:10:53 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d is being set with open permissions: ugo+rw Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:53 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d Jul 21 19:10:53 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:53 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:53 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:54 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d" returned: 0 in 0.338s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-2167a11f-2d3a-4c8c-a327-6b7726c0a82d" released by "_copy_volume_from_snapshot" :: held 8.858s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-116ea520-e78f-464a-b8f3-c6aaaa36f973-2167a11f-2d3a-4c8c-a327-6b7726c0a82d" released by "_create_volume_from_snapshot" :: held 8.927s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.979s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fdd810-8c89-404d-a8e5-c3c64fbae163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d', 'volume_size': 2, 'snapshot_id': '116ea520-e78f-464a-b8f3-c6aaaa36f973'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2da7e2-dfd9-467a-800a-ea9137178e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:54 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Volume volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d (2167a11f-2d3a-4c8c-a327-6b7726c0a82d): created successfully Jul 21 19:10:54 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2da7e2-dfd9-467a-800a-ea9137178e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Flow 'volume_create_manager' (e351455c-15c5-40d3-a00f-1a88ec5962ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.376s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:54 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Deleted volume successfully. Jul 21 19:10:54 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-fedb7518-3ada-4ad4-820e-39b22fdac740 tempest-VolumesSnapshotTestJSON-380021827 None] Created volume successfully. Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0eb3639f-2208-4fe4-b43e-1b53f3821805 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-c4ad228e-5d4b-4d8c-b3c7-80b7b09dbddb-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "cinder-123794ee-cd76-45e9-8820-4cb9129bcade-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-123794ee-cd76-45e9-8820-4cb9129bcade-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "cinder-quobyte-123794ee-cd76-45e9-8820-4cb9129bcade" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-quobyte-123794ee-cd76-45e9-8820-4cb9129bcade" acquired by "delete_volume" :: waited 0.034s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:55 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd142da-42e7-4faa-8b46-2333b519783c]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-123794ee-cd76-45e9-8820-4cb9129bcade {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:55 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-123794ee-cd76-45e9-8820-4cb9129bcade Jul 21 19:10:55 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-2167a11f-2d3a-4c8c-a327-6b7726c0a82d-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-2167a11f-2d3a-4c8c-a327-6b7726c0a82d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-2167a11f-2d3a-4c8c-a327-6b7726c0a82d" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-2167a11f-2d3a-4c8c-a327-6b7726c0a82d" acquired by "delete_volume" :: waited 0.043s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:55 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0af5f28-ba90-4511-91a0-7cb6e5ca8ced]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:55 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-123794ee-cd76-45e9-8820-4cb9129bcade" returned: 0 in 0.688s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-123794ee-cd76-45e9-8820-4cb9129bcade {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:55 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-123794ee-cd76-45e9-8820-4cb9129bcade Jul 21 19:10:55 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:55 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d Jul 21 19:10:55 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:56 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-123794ee-cd76-45e9-8820-4cb9129bcade" returned: 0 in 0.492s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-quobyte-123794ee-cd76-45e9-8820-4cb9129bcade" released by "delete_volume" :: held 1.276s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Created reservations ['f3dbef5f-49a9-407c-b2c1-59bc77c78c2e', '9b055c64-4cce-487a-982a-d87a96e200ae', '247b06d0-5990-42d6-a2af-3660e96b1308', '35b52920-2e2b-4663-a249-d955ad99ab57'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:56 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d" returned: 0 in 0.813s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:56 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:56 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:56 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d Jul 21 19:10:56 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:56 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.392s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:56 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Deleted volume successfully. Jul 21 19:10:56 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2167a11f-2d3a-4c8c-a327-6b7726c0a82d" returned: 0 in 0.420s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-096b82a3-bb92-4431-acbc-e09ad1ca8c72 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-123794ee-cd76-45e9-8820-4cb9129bcade-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-2167a11f-2d3a-4c8c-a327-6b7726c0a82d" released by "delete_volume" :: held 1.356s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Created reservations ['97c06a28-7c1f-474c-9e63-ec63835c9295', 'dcb1d72b-006a-4f7a-9f84-d89c4c2e76f4', 'ea9d234a-0a4d-41c4-9f8b-dc47d175fa60', '156a05be-d370-4207-bb4f-0aeca19914f8'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:57 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:57 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "cinder-168a14c7-27f2-4653-931e-93b84ca77090-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-168a14c7-27f2-4653-931e-93b84ca77090-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "cinder-quobyte-168a14c7-27f2-4653-931e-93b84ca77090" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-quobyte-168a14c7-27f2-4653-931e-93b84ca77090" acquired by "delete_volume" :: waited 0.029s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1a7fff-0149-418e-b861-376658ddae1b]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-168a14c7-27f2-4653-931e-93b84ca77090 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:57 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.408s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:57 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Deleted volume successfully. Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c019c0ee-6190-4d00-9fe5-8b7ae033cf7a tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-2167a11f-2d3a-4c8c-a327-6b7726c0a82d-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:57 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-168a14c7-27f2-4653-931e-93b84ca77090 Jul 21 19:10:57 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-116ea520-e78f-464a-b8f3-c6aaaa36f973-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-116ea520-e78f-464a-b8f3-c6aaaa36f973-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-bb1b607c-4bab-4de7-ba16-1206d81c65ef" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-bb1b607c-4bab-4de7-ba16-1206d81c65ef" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-116ea520-e78f-464a-b8f3-c6aaaa36f973" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-116ea520-e78f-464a-b8f3-c6aaaa36f973" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Deleting offline snapshot 116ea520-e78f-464a-b8f3-c6aaaa36f973 of volume bb1b607c-4bab-4de7-ba16-1206d81c65ef {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] snapshot_file for this snap is: volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[521add54-3ffa-4a20-8d85-129d6f958d23]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:58 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 Jul 21 19:10:58 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:58 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-168a14c7-27f2-4653-931e-93b84ca77090" returned: 0 in 0.714s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-168a14c7-27f2-4653-931e-93b84ca77090 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:58 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-168a14c7-27f2-4653-931e-93b84ca77090 Jul 21 19:10:58 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:58 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:58 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-168a14c7-27f2-4653-931e-93b84ca77090" returned: 0 in 0.436s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973" returned: 0 in 0.675s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:10:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-quobyte-168a14c7-27f2-4653-931e-93b84ca77090" released by "delete_volume" :: held 1.250s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:58 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82b6323-4517-4b05-865d-57cda0ce5bf2]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:58 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Created reservations ['004b847e-8d97-4583-abac-a22c025659b0', '53c71e67-f9cb-4392-bcca-55117ea89d1b', 'f7591286-35b4-4955-ae25-91a799908f62', '8270fa70-0164-4e08-851a-daad125a8f06'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:58 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef Jul 21 19:10:58 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:59 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:59 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:59 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:10:59 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:59 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef" returned: 0 in 0.821s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:59 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 Jul 21 19:10:59 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:59 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.792s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:59 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:59 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Deleted volume successfully. Jul 21 19:10:59 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-afcad7c8-8d80-49ff-8347-3f44aad2ad86 tempest-CreateVolumesFromSourceVolumeTest-1251231607 None] Lock "cinder-168a14c7-27f2-4653-931e-93b84ca77090-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:00 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973" returned: 0 in 0.560s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:00 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973 Jul 21 19:11:00 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:00 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef.116ea520-e78f-464a-b8f3-c6aaaa36f973" returned: 0 in 0.390s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-116ea520-e78f-464a-b8f3-c6aaaa36f973" released by "_delete_snapshot" :: held 2.622s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-bb1b607c-4bab-4de7-ba16-1206d81c65ef" released by "delete_snapshot" :: held 2.651s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:00 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Created reservations ['4a95b44d-62c1-487c-b3c9-aab0f336b66a', '95eae364-e612-4a80-bcb3-ba609825e9e0', 'e3daad25-bc0c-46ca-92d8-6afa7660eb05', '7dde86b8-3213-48b0-8866-d99a488f76eb'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:00 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Delete snapshot completed successfully. Jul 21 19:11:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-565be192-5888-47d3-95b4-b9b2eb852806 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-116ea520-e78f-464a-b8f3-c6aaaa36f973-delete_snapshot" released by "delete_snapshot" :: held 2.829s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-bb1b607c-4bab-4de7-ba16-1206d81c65ef-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-bb1b607c-4bab-4de7-ba16-1206d81c65ef-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-bb1b607c-4bab-4de7-ba16-1206d81c65ef" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-bb1b607c-4bab-4de7-ba16-1206d81c65ef" acquired by "delete_volume" :: waited 0.040s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:01 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3bc8b9-e28c-4fbb-a03e-6369041df8ad]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:01 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef Jul 21 19:11:01 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:02 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef" returned: 0 in 0.646s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:02 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef Jul 21 19:11:02 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:02 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bb1b607c-4bab-4de7-ba16-1206d81c65ef" returned: 0 in 0.409s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-bb1b607c-4bab-4de7-ba16-1206d81c65ef" released by "delete_volume" :: held 1.168s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:02 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Created reservations ['d6c7a5aa-f96d-41a5-b015-3f934eb996fe', '6a4f260c-b488-4592-8b80-9f347aa46d11', 'b02af3a8-d6c8-4367-a30d-373005866ce9', '8bd234e0-0382-4f70-ab25-7db9f3a1b1b9'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:02 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:11:02 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:03 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.416s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:03 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:03 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Deleted volume successfully. Jul 21 19:11:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b74719be-2212-4aae-a295-7c230ee2999b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-bb1b607c-4bab-4de7-ba16-1206d81c65ef-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Flow 'volume_create_manager' (f3ae6fd4-8e0e-4d0e-b8a3-f5fd9d651efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67367ef-360a-4268-ae03-27f0c54fcece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67367ef-360a-4268-ae03-27f0c54fcece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1688273311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f7e985-06da-4a17-892c-3a8920099279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764bb0e2d5a44820b4af9fb9664fa794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:04Z,use_quota=True,user_id='7b47154babbb4e44bd0792618c815b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfedd23-d53f-4a3a-80fc-ad659e787135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfedd23-d53f-4a3a-80fc-ad659e787135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13430e98-3005-403e-8af0-c5b31e692497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13430e98-3005-403e-8af0-c5b31e692497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f7e985-06da-4a17-892c-3a8920099279', 'volume_name': 'volume-86f7e985-06da-4a17-892c-3a8920099279', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f29d751-06ed-4371-abfb-4fd31e17091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f29d751-06ed-4371-abfb-4fd31e17091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799b2bad-30fd-403e-a80c-123a366c5ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:04 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Volume 86f7e985-06da-4a17-892c-3a8920099279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f7e985-06da-4a17-892c-3a8920099279', 'volume_size': 1} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1688273311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f7e985-06da-4a17-892c-3a8920099279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764bb0e2d5a44820b4af9fb9664fa794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:04Z,use_quota=True,user_id='7b47154babbb4e44bd0792618c815b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Creating volume 86f7e985-06da-4a17-892c-3a8920099279 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:04 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:04 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 1073741824 Jul 21 19:11:04 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Flow 'volume_create_manager' (dc038c24-9233-4c26-a531-af6fee38dd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e67ec8-74b2-4c93-ba8f-f4b42f77d10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e67ec8-74b2-4c93-ba8f-f4b42f77d10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-202365699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6df8d0ec6548a6b0d0dfcb954c520e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:04Z,use_quota=True,user_id='1e43beaa592b452fba0353e966593016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92090bfc-57ef-4f93-92bd-e50c432ff4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92090bfc-57ef-4f93-92bd-e50c432ff4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c1121b-706d-46d4-b20a-76f241fde024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c1121b-706d-46d4-b20a-76f241fde024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8', 'volume_name': 'volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af95bba-54cf-4610-b835-ea2cf9253f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af95bba-54cf-4610-b835-ea2cf9253f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64dbc86c-3088-49fc-ba69-8b4e46264889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:04 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Volume cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8', 'volume_size': 1} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:04 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 1073741824" returned: 0 in 0.628s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:04 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 Jul 21 19:11:04 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:05 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279" returned: 0 in 0.286s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.601s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-202365699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6df8d0ec6548a6b0d0dfcb954c520e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:04Z,use_quota=True,user_id='1e43beaa592b452fba0353e966593016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Creating volume cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:05 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799b2bad-30fd-403e-a80c-123a366c5ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f7e985-06da-4a17-892c-3a8920099279', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:05 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 1073741824 Jul 21 19:11:05 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875ffe22-db27-470c-92ae-ae557ba5f3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:05 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Volume volume-86f7e985-06da-4a17-892c-3a8920099279 (86f7e985-06da-4a17-892c-3a8920099279): created successfully Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875ffe22-db27-470c-92ae-ae557ba5f3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Flow 'volume_create_manager' (f3ae6fd4-8e0e-4d0e-b8a3-f5fd9d651efa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a4d7a40d-e178-4fe5-b7cf-aa4f4a853f69 tempest-VolumeDependencyTests-1001215332 None] Created volume successfully. Jul 21 19:11:05 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 1073741824" returned: 0 in 0.502s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:05 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 Jul 21 19:11:05 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:06 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8" returned: 0 in 0.261s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64dbc86c-3088-49fc-ba69-8b4e46264889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c244b5bb-4795-48e2-9a98-5d62e0d6ca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:06 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Volume volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 (cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8): created successfully Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c244b5bb-4795-48e2-9a98-5d62e0d6ca6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Flow 'volume_create_manager' (dc038c24-9233-4c26-a531-af6fee38dd44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:06 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-e976e586-b7ac-4f7f-8dda-e28863a1494b tempest-VolumesSnapshotTestJSON-380021827 None] Created volume successfully. Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] Creating offline snapshot 3f75000c-0879-4332-a616-b42d35c1cd71 of volume 86f7e985-06da-4a17-892c-3a8920099279 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4df339-cbab-49f1-9e88-4b5c96e7508e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:06 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 Jul 21 19:11:06 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:06 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279" returned: 0 in 0.482s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:06 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 1G Jul 21 19:11:06 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:07 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 1G" returned: 0 in 0.452s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86f7e985-06da-4a17-892c-3a8920099279 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:07 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86f7e985-06da-4a17-892c-3a8920099279 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 Jul 21 19:11:07 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:07 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86f7e985-06da-4a17-892c-3a8920099279 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71" returned: 0 in 0.343s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:07 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 is being set with open permissions: ugo+rw Jul 21 19:11:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:07 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 Jul 21 19:11:07 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:08 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71" returned: 0 in 0.356s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:08 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.info Jul 21 19:11:08 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:08 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.info" returned: 0 in 0.311s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:08 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.info is being set with open permissions: ugo+rw Jul 21 19:11:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:08 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.info Jul 21 19:11:08 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:08 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.info" returned: 0 in 0.257s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.334s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.892s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:08 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] Creating offline snapshot 8b315c7a-4a32-4389-893c-d146f92cafc7 of volume cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:11:08 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf68c51-c3be-4477-afe0-c0c0ec4aee5b]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:08 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-0450b1e9-6f23-4c79-a5db-bb4e8ed6a477 tempest-VolumeDependencyTests-1001215332 None] Create snapshot completed successfully Jul 21 19:11:08 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 Jul 21 19:11:08 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:09 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8" returned: 0 in 0.472s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:09 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 1G Jul 21 19:11:09 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:09 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 1G" returned: 0 in 0.476s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:09 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 Jul 21 19:11:09 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:10 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7" returned: 0 in 0.373s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:10 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 is being set with open permissions: ugo+rw Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:10 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 Jul 21 19:11:10 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Flow 'volume_create_manager' (0ca390fc-cc8c-48c4-874b-15262430a590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a80e8d6-2872-4f30-91bf-f3c570d5b3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a80e8d6-2872-4f30-91bf-f3c570d5b3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1707223831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e88e61-4685-4237-b5d3-a4f669d6992e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764bb0e2d5a44820b4af9fb9664fa794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3f75000c-0879-4332-a616-b42d35c1cd71,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:10Z,use_quota=True,user_id='7b47154babbb4e44bd0792618c815b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b045b26-3594-420a-9423-0614ff6661dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b045b26-3594-420a-9423-0614ff6661dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3eec5cf-889c-43d9-816b-d9ffd2792c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3eec5cf-889c-43d9-816b-d9ffd2792c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c1e88e61-4685-4237-b5d3-a4f669d6992e', 'volume_name': 'volume-c1e88e61-4685-4237-b5d3-a4f669d6992e', 'volume_size': 1, 'snapshot_id': '3f75000c-0879-4332-a616-b42d35c1cd71'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a165f50a-c2d5-47cb-9a83-35789865dd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a165f50a-c2d5-47cb-9a83-35789865dd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30faf51-ad70-471a-a5d2-f1c2524aa7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:10 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Volume c1e88e61-4685-4237-b5d3-a4f669d6992e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c1e88e61-4685-4237-b5d3-a4f669d6992e', 'volume_size': 1, 'snapshot_id': '3f75000c-0879-4332-a616-b42d35c1cd71'} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:10 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7" returned: 0 in 0.283s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:10 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.info Jul 21 19:11:10 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:10 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.info" returned: 0 in 0.250s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:10 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.info is being set with open permissions: ugo+rw Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:10 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.info Jul 21 19:11:10 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:10 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.info" returned: 0 in 0.233s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.629s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:10 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "cinder-quobyte-3f75000c-0879-4332-a616-b42d35c1cd71-c1e88e61-4685-4237-b5d3-a4f669d6992e" by "_create_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-quobyte-3f75000c-0879-4332-a616-b42d35c1cd71-c1e88e61-4685-4237-b5d3-a4f669d6992e" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Creating volume c1e88e61-4685-4237-b5d3-a4f669d6992e from snapshot 3f75000c-0879-4332-a616-b42d35c1cd71 {{(pid=87487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "cinder-quobyte-c1e88e61-4685-4237-b5d3-a4f669d6992e" by "_copy_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:11 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f63e5cb7-2656-40e2-a993-0a485077ddf2 tempest-VolumesSnapshotTestJSON-380021827 None] Create snapshot completed successfully Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-quobyte-c1e88e61-4685-4237-b5d3-a4f669d6992e" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] snapshot: 3f75000c-0879-4332-a616-b42d35c1cd71, volume: c1e88e61-4685-4237-b5d3-a4f669d6992e, {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c3ec4d-81e9-4ae3-a71f-17a4dbd92f48]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:11 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 Jul 21 19:11:11 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:11 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71" returned: 0 in 0.371s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86f7e985-06da-4a17-892c-3a8920099279(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Creating direct copy from snapshot {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7c9013-2464-436d-8a82-008259ab453a]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:11 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 Jul 21 19:11:11 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:11 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279" returned: 0 in 0.452s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG cinder.utils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Path /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e not found in is_blk_device check {{(pid=87487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:11:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:11 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e Jul 21 19:11:11 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:13 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Flow 'volume_create_manager' (dec3ea51-8936-479a-acda-b8ec62235029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bea2a6-d62e-41a1-8386-28ff5fd59dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bea2a6-d62e-41a1-8386-28ff5fd59dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1285080332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed2ad43-3e8b-433b-970e-12f8167a3336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6df8d0ec6548a6b0d0dfcb954c520e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8b315c7a-4a32-4389-893c-d146f92cafc7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:13Z,use_quota=True,user_id='1e43beaa592b452fba0353e966593016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7062d3-2a3e-4589-8389-cdc4102230d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7062d3-2a3e-4589-8389-cdc4102230d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7356fefa-d24a-42c2-904a-7b63077bc922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7356fefa-d24a-42c2-904a-7b63077bc922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ed2ad43-3e8b-433b-970e-12f8167a3336', 'volume_name': 'volume-9ed2ad43-3e8b-433b-970e-12f8167a3336', 'volume_size': 1, 'snapshot_id': '8b315c7a-4a32-4389-893c-d146f92cafc7'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f17b9e3-3405-45dc-944d-b1bce1fc61b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f17b9e3-3405-45dc-944d-b1bce1fc61b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e67e0b-c469-4cc9-800b-5726259a8339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Volume 9ed2ad43-3e8b-433b-970e-12f8167a3336: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ed2ad43-3e8b-433b-970e-12f8167a3336', 'volume_size': 1, 'snapshot_id': '8b315c7a-4a32-4389-893c-d146f92cafc7'} Jul 21 19:11:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:17 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e" returned: 0 in 5.360s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:17 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[336ae893-47dd-4668-be22-cfbb42c655d8]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:17 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 Jul 21 19:11:17 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:17 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279" returned: 0 in 0.664s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:11:18 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Converted 1024.00 MB image at 191.00 MB/s Jul 21 19:11:18 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e is being set with open permissions: ugo+rw Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:18 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e Jul 21 19:11:18 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:18 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e" returned: 0 in 0.307s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-quobyte-c1e88e61-4685-4237-b5d3-a4f669d6992e" released by "_copy_volume_from_snapshot" :: held 7.267s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-quobyte-3f75000c-0879-4332-a616-b42d35c1cd71-c1e88e61-4685-4237-b5d3-a4f669d6992e" released by "_create_volume_from_snapshot" :: held 7.310s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.340s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.787s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-8b315c7a-4a32-4389-893c-d146f92cafc7-9ed2ad43-3e8b-433b-970e-12f8167a3336" by "_create_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=124,cinder:INSERT=42,cinder:UPDATE=155,cinder:DELETE=18 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=123,cinder:UPDATE=155,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-8b315c7a-4a32-4389-893c-d146f92cafc7-9ed2ad43-3e8b-433b-970e-12f8167a3336" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Creating volume 9ed2ad43-3e8b-433b-970e-12f8167a3336 from snapshot 8b315c7a-4a32-4389-893c-d146f92cafc7 {{(pid=87487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-9ed2ad43-3e8b-433b-970e-12f8167a3336" by "_copy_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30faf51-ad70-471a-a5d2-f1c2524aa7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e88e61-4685-4237-b5d3-a4f669d6992e', 'volume_size': 1, 'snapshot_id': '3f75000c-0879-4332-a616-b42d35c1cd71'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd477e19-885d-4147-ac59-49e1630b5a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-9ed2ad43-3e8b-433b-970e-12f8167a3336" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] snapshot: 8b315c7a-4a32-4389-893c-d146f92cafc7, volume: 9ed2ad43-3e8b-433b-970e-12f8167a3336, {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:11:18 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Volume volume-c1e88e61-4685-4237-b5d3-a4f669d6992e (c1e88e61-4685-4237-b5d3-a4f669d6992e): created successfully Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd477e19-885d-4147-ac59-49e1630b5a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Flow 'volume_create_manager' (0ca390fc-cc8c-48c4-874b-15262430a590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c8f652-5e80-4279-b81d-c2cda5990cd6]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:18 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-84582590-221e-47d1-a84e-56cc7497d264 tempest-VolumeDependencyTests-1001215332 None] Created volume successfully. Jul 21 19:11:18 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 Jul 21 19:11:18 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:18 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7" returned: 0 in 0.410s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Creating direct copy from snapshot {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c8b93b-a8b1-4745-b06b-7cd0e2bc8251]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:19 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 Jul 21 19:11:19 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "cinder-3f75000c-0879-4332-a616-b42d35c1cd71-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-3f75000c-0879-4332-a616-b42d35c1cd71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "cinder-quobyte-86f7e985-06da-4a17-892c-3a8920099279" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-quobyte-86f7e985-06da-4a17-892c-3a8920099279" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "cinder-quobyte-3f75000c-0879-4332-a616-b42d35c1cd71" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-quobyte-3f75000c-0879-4332-a616-b42d35c1cd71" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Deleting offline snapshot 3f75000c-0879-4332-a616-b42d35c1cd71 of volume 86f7e985-06da-4a17-892c-3a8920099279 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] snapshot_file for this snap is: volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:11:19 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8" returned: 0 in 0.461s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG cinder.utils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Path /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336 not found in is_blk_device check {{(pid=87487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c84ad1-e12e-4e6a-8f8d-d3572b13b87a]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:19 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336 Jul 21 19:11:19 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:19 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 Jul 21 19:11:19 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:19 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71" returned: 0 in 0.435s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86f7e985-06da-4a17-892c-3a8920099279(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91069b4-2511-498a-bd75-7d2e26454e1d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:20 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 Jul 21 19:11:20 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:21 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279" returned: 0 in 1.156s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:21 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 Jul 21 19:11:21 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:22 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71" returned: 0 in 0.991s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Flow 'volume_create_manager' (ad578291-50a0-4697-9570-fbf7e1e5e256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:22 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71 Jul 21 19:11:22 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d785f0ea-386c-44c4-ab5a-0e47a7e26185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d785f0ea-386c-44c4-ab5a-0e47a7e26185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1816382899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f194354-f9fe-4403-b8a8-11258544ff17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4746159189d417d8ffa41e7cc25fc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:22Z,use_quota=True,user_id='6b14f6e02a5a4c7bb4b11f933b57d53d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0699fe-a8ea-4262-87f9-ce4113868b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0699fe-a8ea-4262-87f9-ce4113868b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a95d50-81ef-4ad5-bc6d-e36a7eb028f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a95d50-81ef-4ad5-bc6d-e36a7eb028f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f194354-f9fe-4403-b8a8-11258544ff17', 'volume_name': 'volume-6f194354-f9fe-4403-b8a8-11258544ff17', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a24fdee-2b12-44bc-bfae-708c64325413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a24fdee-2b12-44bc-bfae-708c64325413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdea90a-267a-42b0-9871-859b58c4c660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:22 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Volume 6f194354-f9fe-4403-b8a8-11258544ff17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f194354-f9fe-4403-b8a8-11258544ff17', 'volume_size': 1} Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:22 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279.3f75000c-0879-4332-a616-b42d35c1cd71" returned: 0 in 0.705s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-quobyte-3f75000c-0879-4332-a616-b42d35c1cd71" released by "_delete_snapshot" :: held 3.517s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-quobyte-86f7e985-06da-4a17-892c-3a8920099279" released by "delete_snapshot" :: held 3.557s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:23 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Created reservations ['d7c2d2d1-d2dd-4a76-a5e4-e27dba0f477b', '31361f84-ed43-45dd-97a9-63999df92e4f', 'c14badfd-9bea-4ea2-a401-b13d4bb401dd', '7fb6eeed-59e1-4fd9-b823-40b7d40241dd'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:23 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Delete snapshot completed successfully. Jul 21 19:11:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b3cdf58d-1021-4d38-9481-0c7762de05ee tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-3f75000c-0879-4332-a616-b42d35c1cd71-delete_snapshot" released by "delete_snapshot" :: held 4.070s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "cinder-86f7e985-06da-4a17-892c-3a8920099279-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-86f7e985-06da-4a17-892c-3a8920099279-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "cinder-quobyte-86f7e985-06da-4a17-892c-3a8920099279" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-quobyte-86f7e985-06da-4a17-892c-3a8920099279" acquired by "delete_volume" :: waited 0.049s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:24 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab6524f-346b-4e53-a365-1dc910d09fa7]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:24 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 Jul 21 19:11:24 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:24 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279" returned: 0 in 0.625s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:24 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279 Jul 21 19:11:24 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:25 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-86f7e985-06da-4a17-892c-3a8920099279" returned: 0 in 0.531s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-quobyte-86f7e985-06da-4a17-892c-3a8920099279" released by "delete_volume" :: held 1.356s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Created reservations ['df625257-c90e-44cc-b0c0-9a0191d5d463', '3f861d8d-5586-48c6-8307-7f4db29105f8', '12026f59-af76-4940-a469-fd73126823db', 'c0391815-bfbb-4233-8134-67eb4b3080d8'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:25 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336" returned: 0 in 6.216s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7af047-26b7-462d-8610-c69d9142170f]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:25 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:11:25 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:25 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 Jul 21 19:11:25 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:25 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.303s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Deleted volume successfully. Jul 21 19:11:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-86844110-9661-4f0f-b713-c8d012f4e047 tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-86f7e985-06da-4a17-892c-3a8920099279-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:26 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8" returned: 0 in 0.633s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:11:26 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Converted 1024.00 MB image at 164.67 MB/s Jul 21 19:11:26 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336 is being set with open permissions: ugo+rw Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "cinder-c1e88e61-4685-4237-b5d3-a4f669d6992e-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:26 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336 Jul 21 19:11:26 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-c1e88e61-4685-4237-b5d3-a4f669d6992e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "cinder-quobyte-c1e88e61-4685-4237-b5d3-a4f669d6992e" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-quobyte-c1e88e61-4685-4237-b5d3-a4f669d6992e" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a61eca-89a2-4a3a-a049-02b5b1d5c49d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:26 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e Jul 21 19:11:26 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:26 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336" returned: 0 in 0.323s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-9ed2ad43-3e8b-433b-970e-12f8167a3336" released by "_copy_volume_from_snapshot" :: held 8.167s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-8b315c7a-4a32-4389-893c-d146f92cafc7-9ed2ad43-3e8b-433b-970e-12f8167a3336" released by "_create_volume_from_snapshot" :: held 8.226s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.254s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.277s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1816382899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f194354-f9fe-4403-b8a8-11258544ff17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4746159189d417d8ffa41e7cc25fc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:22Z,use_quota=True,user_id='6b14f6e02a5a4c7bb4b11f933b57d53d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Creating volume 6f194354-f9fe-4403-b8a8-11258544ff17 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:26 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f194354-f9fe-4403-b8a8-11258544ff17 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:26 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f194354-f9fe-4403-b8a8-11258544ff17 1073741824 Jul 21 19:11:26 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e67e0b-c469-4cc9-800b-5726259a8339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed2ad43-3e8b-433b-970e-12f8167a3336', 'volume_size': 1, 'snapshot_id': '8b315c7a-4a32-4389-893c-d146f92cafc7'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028cba51-1e45-4933-8cef-3253e09aed8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:26 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Volume volume-9ed2ad43-3e8b-433b-970e-12f8167a3336 (9ed2ad43-3e8b-433b-970e-12f8167a3336): created successfully Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028cba51-1e45-4933-8cef-3253e09aed8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Flow 'volume_create_manager' (dec3ea51-8936-479a-acda-b8ec62235029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:26 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3e80852e-aebc-4fce-9c18-0ff0a426797b tempest-VolumesSnapshotTestJSON-380021827 None] Created volume successfully. Jul 21 19:11:26 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e" returned: 0 in 0.391s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:26 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e Jul 21 19:11:26 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:27 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c1e88e61-4685-4237-b5d3-a4f669d6992e" returned: 0 in 0.316s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-quobyte-c1e88e61-4685-4237-b5d3-a4f669d6992e" released by "delete_volume" :: held 0.754s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:27 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f194354-f9fe-4403-b8a8-11258544ff17 1073741824" returned: 0 in 0.550s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f194354-f9fe-4403-b8a8-11258544ff17 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Created reservations ['b9f9ca93-0e99-4b4f-b7fc-db3fac8d6eb2', 'fc74917e-8936-4e34-a778-49bd48b7f6e5', '76e7f95a-a3e4-4600-8b63-737c7c51bab1', '63f0657f-9915-4319-935d-817a6174df84'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:27 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f194354-f9fe-4403-b8a8-11258544ff17 Jul 21 19:11:27 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:27 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:11:27 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:27 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f194354-f9fe-4403-b8a8-11258544ff17" returned: 0 in 0.281s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdea90a-267a-42b0-9871-859b58c4c660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f194354-f9fe-4403-b8a8-11258544ff17', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90765c85-4cbf-45da-8ea5-5f3c20fe9afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:27 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Volume volume-6f194354-f9fe-4403-b8a8-11258544ff17 (6f194354-f9fe-4403-b8a8-11258544ff17): created successfully Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90765c85-4cbf-45da-8ea5-5f3c20fe9afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Flow 'volume_create_manager' (ad578291-50a0-4697-9570-fbf7e1e5e256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:27 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3259ddb1-284b-4041-a0ff-b1236e058dbe tempest-AttachVolumeNegativeTest-37116685 None] Created volume successfully. Jul 21 19:11:27 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.282s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:27 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Deleted volume successfully. Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7c0c5482-bc79-49ad-a932-d42cf6d7df4c tempest-VolumeDependencyTests-1001215332 None] Lock "cinder-c1e88e61-4685-4237-b5d3-a4f669d6992e-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-9ed2ad43-3e8b-433b-970e-12f8167a3336-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-9ed2ad43-3e8b-433b-970e-12f8167a3336-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-9ed2ad43-3e8b-433b-970e-12f8167a3336" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-9ed2ad43-3e8b-433b-970e-12f8167a3336" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[441dde72-b775-42d1-83ba-958edc7aff0c]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:28 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336 Jul 21 19:11:28 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:28 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336" returned: 0 in 0.432s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:28 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336 Jul 21 19:11:28 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:28 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9ed2ad43-3e8b-433b-970e-12f8167a3336" returned: 0 in 0.265s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-9ed2ad43-3e8b-433b-970e-12f8167a3336" released by "delete_volume" :: held 0.747s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:28 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Created reservations ['f7b248bb-eb1c-4dfa-aa4a-6d6e2cd1da2c', '1520686c-36f4-453d-a8de-7af2018c1302', '4b81ad5e-b846-43d5-ab48-318e9fe96c43', 'a1dd5915-ac17-4f76-aeeb-56ef7a2da879'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:28 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:28 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:28 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:11:28 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-8b315c7a-4a32-4389-893c-d146f92cafc7-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-8b315c7a-4a32-4389-893c-d146f92cafc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-8b315c7a-4a32-4389-893c-d146f92cafc7" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-8b315c7a-4a32-4389-893c-d146f92cafc7" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Deleting offline snapshot 8b315c7a-4a32-4389-893c-d146f92cafc7 of volume cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] snapshot_file for this snap is: volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade28c20-7aaf-4962-9190-dfd83e6f8275]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:29 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 Jul 21 19:11:29 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:29 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.595s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:29 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Deleted volume successfully. Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bd808ff3-2fe7-4937-8ae4-2217c265aa83 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-9ed2ad43-3e8b-433b-970e-12f8167a3336-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:29 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7" returned: 0 in 0.518s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7289ee07-dd06-4600-bf55-327c50b13e93]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:29 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 Jul 21 19:11:29 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:30 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8" returned: 0 in 0.462s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-47a1620d-939a-49a8-ba23-72ae53f1eee2 req-2a32da49-70df-4cd9-8772-8b10a106c0b5 tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-47a1620d-939a-49a8-ba23-72ae53f1eee2 req-2a32da49-70df-4cd9-8772-8b10a106c0b5 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:30 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 Jul 21 19:11:30 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-47a1620d-939a-49a8-ba23-72ae53f1eee2 req-2a32da49-70df-4cd9-8772-8b10a106c0b5 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-47a1620d-939a-49a8-ba23-72ae53f1eee2 req-2a32da49-70df-4cd9-8772-8b10a106c0b5 tempest-AttachVolumeNegativeTest-37116685 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-6f194354-f9fe-4403-b8a8-11258544ff17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f308b64-e950-4ce6-9e2c-f9d0933dfbcd', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:11:30 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-47a1620d-939a-49a8-ba23-72ae53f1eee2 req-2a32da49-70df-4cd9-8772-8b10a106c0b5 tempest-AttachVolumeNegativeTest-37116685 None] attachment_update completed successfully. Jul 21 19:11:30 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7" returned: 0 in 0.557s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:30 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7 Jul 21 19:11:30 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:31 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8.8b315c7a-4a32-4389-893c-d146f92cafc7" returned: 0 in 0.423s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-8b315c7a-4a32-4389-893c-d146f92cafc7" released by "_delete_snapshot" :: held 2.130s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8" released by "delete_snapshot" :: held 2.184s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:31 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Created reservations ['bdca2194-1d35-4352-9177-27fba6233397', '6605a13d-443b-4922-93da-874b1f7d61f7', '4c20ede7-0157-44f0-a05e-94bb2e60bffb', '03d4d63b-764d-405f-9aa9-4be9d2aaafb0'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:31 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Delete snapshot completed successfully. Jul 21 19:11:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b2441f1d-844c-4108-983d-4619778e62bc tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-8b315c7a-4a32-4389-893c-d146f92cafc7-delete_snapshot" released by "delete_snapshot" :: held 2.464s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8" acquired by "delete_volume" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:32 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[147eab6b-19f4-4233-bdcf-c551093c845a]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:32 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 Jul 21 19:11:32 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:33 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8" returned: 0 in 0.528s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:33 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8 Jul 21 19:11:33 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:33 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8" returned: 0 in 0.356s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8" released by "delete_volume" :: held 0.980s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:33 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Created reservations ['258e1bcb-fd76-4c0a-875a-f6f75b29ddb4', '5ff9fcba-89f9-403e-b276-e92355418e2a', 'b1fd753f-e8f9-46e6-91da-19858360948e', '1bcc5371-ece1-4730-b2a3-8efd371a141a'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:33 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:11:33 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:34 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.390s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:34 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:34 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Deleted volume successfully. Jul 21 19:11:34 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-09b20d06-48df-4e69-8954-f2cbf288c791 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-cc8d2b5e-7b36-4475-9dc8-cd33dc48b4f8-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "cinder-quobyte-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4" acquired by "delete_volume" :: waited 0.025s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:35 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a689d177-5baa-4b12-b8fb-c9cf4815b0ef]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:35 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 Jul 21 19:11:35 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:35 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4" returned: 0 in 0.447s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:35 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4 Jul 21 19:11:35 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:35 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4" returned: 0 in 0.285s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-quobyte-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4" released by "delete_volume" :: held 0.813s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:36 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Created reservations ['0ff35d51-f85e-476c-9601-bbb0ba58ac41', '2c63fa9e-3865-49e9-8300-7ddcbab72fd8', '57f709eb-d4df-4494-83f3-4e3561c73571', 'fd22c159-ab3e-462f-8ba4-8dcd6fccc4d4'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:36 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:11:36 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:36 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.301s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:36 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:36 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Deleted volume successfully. Jul 21 19:11:36 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-761a190b-886a-4373-9000-e247e2b7a7d9 tempest-VolumesSnapshotTestJSON-380021827 None] Lock "cinder-b07a44b1-c6f8-48ba-abd0-b0c02c6e12d4-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:11:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:40 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:11:40 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:41 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.389s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:41 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:41 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:11:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:11:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:11:43 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Flow 'volume_create_manager' (7a360d29-5581-41be-905e-7bd6f68e40d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5a3ad8-625b-45c0-ac80-f7f4d5e9477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5a3ad8-625b-45c0-ac80-f7f4d5e9477a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1531934327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7481e8-b262-4845-a73d-5bd533363f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2062e9eb35424ada9935ec787f1514fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:44Z,use_quota=True,user_id='f17ea05aba65469d876348815b34e21a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f93edcc-3c34-445c-98f9-e1f7387c57f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f93edcc-3c34-445c-98f9-e1f7387c57f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7616aa5d-c645-4bb6-bb81-f6d180f4707e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:43 devstack cinder-volume[87487]: DEBUG cinder.image.glance [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Creating Keystone auth plugin from conf {{(pid=87487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:11:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7616aa5d-c645-4bb6-bb81-f6d180f4707e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a7481e8-b262-4845-a73d-5bd533363f94', 'volume_name': 'volume-1a7481e8-b262-4845-a73d-5bd533363f94', 'volume_size': 1, 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3621f130346745d7901341d043a6da99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'created_at': datetime.datetime(2026, 7, 21, 16, 56, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc66b18b-6093-4756-9dba-09c30714a99f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f9ea58-7eb8-4b0f-be32-9d84687db235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f9ea58-7eb8-4b0f-be32-9d84687db235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb71c47c-4dc0-43a3-b708-c6ec9f235939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:45 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Volume 1a7481e8-b262-4845-a73d-5bd533363f94: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a7481e8-b262-4845-a73d-5bd533363f94', 'volume_size': 1, 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3621f130346745d7901341d043a6da99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'created_at': datetime.datetime(2026, 7, 21, 16, 56, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc66b18b-6093-4756-9dba-09c30714a99f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 19:11:45 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Trying to clone 1a7481e8-b262-4845-a73d-5bd533363f94 from image cc66b18b-6093-4756-9dba-09c30714a99f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]). {{(pid=87487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:11:45 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_y5zvol0idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:11:45 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Image download 20.69 MB at 20.69 MB/s Jul 21 19:11:45 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9b6388-2338-4887-92e2-8f663cc03c68]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_y5zvol0idevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:45 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_y5zvol0idevstack@QuobyteHD Jul 21 19:11:45 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:46 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_y5zvol0idevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Temporary image cc66b18b-6093-4756-9dba-09c30714a99f is fetched for user f17ea05aba65469d876348815b34e21a. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[452bbb0d-4587-41dc-8967-c1ddec2db1d6]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_y5zvol0idevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:46 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_y5zvol0idevstack@QuobyteHD Jul 21 19:11:46 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:46 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_y5zvol0idevstack@QuobyteHD" returned: 0 in 0.576s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1531934327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7481e8-b262-4845-a73d-5bd533363f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2062e9eb35424ada9935ec787f1514fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:44Z,use_quota=True,user_id='f17ea05aba65469d876348815b34e21a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Creating volume 1a7481e8-b262-4845-a73d-5bd533363f94 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:46 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:11:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:46 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 1073741824 Jul 21 19:11:46 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:47 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 1073741824" returned: 0 in 0.499s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:47 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 Jul 21 19:11:47 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:47 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94" returned: 0 in 0.253s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:47 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Attempting download of cc66b18b-6093-4756-9dba-09c30714a99f ((None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}])) to volume 1a7481e8-b262-4845-a73d-5bd533363f94. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:11:47 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7817aad7-5581-4378-9724-1ac8a83796d6]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_bm4xg7yj {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:47 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_bm4xg7yj Jul 21 19:11:47 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:48 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_bm4xg7yj" returned: 0 in 0.533s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_bm4xg7yj {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:48 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_bm4xg7yj Jul 21 19:11:48 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:48 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_bm4xg7yj" returned: 1 in 0.393s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_bm4xg7yj' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:11:48 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa65e1de-1dea-4100-ad00-dddf7c52bbe1]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_y5zvol0idevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:48 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_y5zvol0idevstack@QuobyteHD Jul 21 19:11:48 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:49 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_y5zvol0idevstack@QuobyteHD" returned: 0 in 0.538s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:49 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] cc66b18b-6093-4756-9dba-09c30714a99f was qcow2, converting to qcow2 {{(pid=87487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:11:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_y5zvol0idevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:49 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_y5zvol0idevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 Jul 21 19:11:49 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:51 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_y5zvol0idevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94" returned: 0 in 1.975s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:51 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_y5zvol0idevstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:11:51 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Converted 112.00 MB image at 56.65 MB/s Jul 21 19:11:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:51 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 1G Jul 21 19:11:51 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:51 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 1G" returned: 0 in 0.322s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:51 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Downloaded image cc66b18b-6093-4756-9dba-09c30714a99f ((None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}])) to volume 1a7481e8-b262-4845-a73d-5bd533363f94 successfully. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:11:51 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Temporary image cc66b18b-6093-4756-9dba-09c30714a99f for user f17ea05aba65469d876348815b34e21a is deleted. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:11:51 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Marking volume 1a7481e8-b262-4845-a73d-5bd533363f94 as bootable. {{(pid=87487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:11:51 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Copying metadata from image cc66b18b-6093-4756-9dba-09c30714a99f to 1a7481e8-b262-4845-a73d-5bd533363f94. {{(pid=87487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:11:51 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Creating volume glance metadata for volume 1a7481e8-b262-4845-a73d-5bd533363f94 backed by image cc66b18b-6093-4756-9dba-09c30714a99f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:11:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb71c47c-4dc0-43a3-b708-c6ec9f235939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a7481e8-b262-4845-a73d-5bd533363f94', 'volume_size': 1, 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3621f130346745d7901341d043a6da99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'created_at': datetime.datetime(2026, 7, 21, 16, 56, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc66b18b-6093-4756-9dba-09c30714a99f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fa961a-dc83-41c3-85c0-476cc3abcbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:51 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Volume volume-1a7481e8-b262-4845-a73d-5bd533363f94 (1a7481e8-b262-4845-a73d-5bd533363f94): created successfully Jul 21 19:11:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fa961a-dc83-41c3-85c0-476cc3abcbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Flow 'volume_create_manager' (7a360d29-5581-41be-905e-7bd6f68e40d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:51 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-90001528-8996-442d-b26e-9e9f5624774f tempest-TestShelveInstance-1384022846 None] Created volume successfully. Jul 21 19:11:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-29230703-d908-482b-9d07-0414b771b384 req-f4a5c136-2c14-47a2-a53b-a3b0ed2ecae1 tempest-TestShelveInstance-1384022846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-29230703-d908-482b-9d07-0414b771b384 req-f4a5c136-2c14-47a2-a53b-a3b0ed2ecae1 tempest-TestShelveInstance-1384022846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-29230703-d908-482b-9d07-0414b771b384 req-f4a5c136-2c14-47a2-a53b-a3b0ed2ecae1 tempest-TestShelveInstance-1384022846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-29230703-d908-482b-9d07-0414b771b384 req-f4a5c136-2c14-47a2-a53b-a3b0ed2ecae1 tempest-TestShelveInstance-1384022846 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-1a7481e8-b262-4845-a73d-5bd533363f94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '669210e6-a252-4eb4-b31f-d4097d29b7cb', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:11:55 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-29230703-d908-482b-9d07-0414b771b384 req-f4a5c136-2c14-47a2-a53b-a3b0ed2ecae1 tempest-TestShelveInstance-1384022846 None] attachment_update completed successfully. Jul 21 19:12:05 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:UPDATE=72,cinder:SELECT=60,cinder:INSERT=19,cinder:DELETE=2 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:12:05 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:DELETE=7,cinder:UPDATE=56,cinder:SELECT=63,cinder:INSERT=24 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:12:14 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-341e06dd-76ce-40be-8f1c-126c8d27c65f req-8747de04-3b0b-422d-89c7-2fac9ea923a7 tempest-AttachVolumeNegativeTest-37116685 None] Terminate volume connection completed successfully. Jul 21 19:12:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-341e06dd-76ce-40be-8f1c-126c8d27c65f req-8747de04-3b0b-422d-89c7-2fac9ea923a7 tempest-AttachVolumeNegativeTest-37116685 None] Deleting attachment 3f308b64-e950-4ce6-9e2c-f9d0933dfbcd. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:12:24 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=1 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:12:24 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=1 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:12:32 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-bed95d9b-7111-4af1-98c1-1e14d0e3302a req-47ef7f7e-f04e-412f-a63a-e164d398cf14 tempest-TestShelveInstance-1384022846 None] Terminate volume connection completed successfully. Jul 21 19:12:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-bed95d9b-7111-4af1-98c1-1e14d0e3302a req-47ef7f7e-f04e-412f-a63a-e164d398cf14 tempest-TestShelveInstance-1384022846 None] Deleting attachment 669210e6-a252-4eb4-b31f-d4097d29b7cb. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:12:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-d44d4adb-ee66-43a4-ac03-18b1d616a4fb req-6323e600-ae56-4a3a-a502-f42848b6bdd0 tempest-TestShelveInstance-1384022846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-d44d4adb-ee66-43a4-ac03-18b1d616a4fb req-6323e600-ae56-4a3a-a502-f42848b6bdd0 tempest-TestShelveInstance-1384022846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-d44d4adb-ee66-43a4-ac03-18b1d616a4fb req-6323e600-ae56-4a3a-a502-f42848b6bdd0 tempest-TestShelveInstance-1384022846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d44d4adb-ee66-43a4-ac03-18b1d616a4fb req-6323e600-ae56-4a3a-a502-f42848b6bdd0 tempest-TestShelveInstance-1384022846 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-1a7481e8-b262-4845-a73d-5bd533363f94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '787517f5-01f4-4bd9-9c77-05f8678d3216', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:12:35 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-d44d4adb-ee66-43a4-ac03-18b1d616a4fb req-6323e600-ae56-4a3a-a502-f42848b6bdd0 tempest-TestShelveInstance-1384022846 None] attachment_update completed successfully. Jul 21 19:12:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:12:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:40 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:12:40 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:40 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.316s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:40 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:12:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:12:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:12:43 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Flow 'volume_create_manager' (dd2962ae-43f1-4149-ab20-1b801c2a1ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45ca1ef-a141-46d7-bfe8-732d4c347548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45ca1ef-a141-46d7-bfe8-732d4c347548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-673789079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e34dfc09b474914bb0beb4ebe8b984c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:44Z,use_quota=True,user_id='666136891ce14f40a4748af0f243f21f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4962a2-57d9-4b57-a49e-bff604607716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4962a2-57d9-4b57-a49e-bff604607716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e338316c-817b-4909-9031-ffaf9b16964e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e338316c-817b-4909-9031-ffaf9b16964e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4c4ecfd-59bc-4537-ba40-5ce5a1f4de24', 'volume_name': 'volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90bf9cf-ce20-45e0-853f-428ef278f8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90bf9cf-ce20-45e0-853f-428ef278f8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344c1813-89db-4ff0-ab78-c86b0ec0376c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Volume d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24', 'volume_size': 1} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-673789079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e34dfc09b474914bb0beb4ebe8b984c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:44Z,use_quota=True,user_id='666136891ce14f40a4748af0f243f21f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Creating volume d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:44 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:44 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24 1073741824 Jul 21 19:12:44 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:44 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24 1073741824" returned: 0 in 0.444s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:44 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24 Jul 21 19:12:44 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:44 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24" returned: 0 in 0.250s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344c1813-89db-4ff0-ab78-c86b0ec0376c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193e748a-08ac-4fac-90c0-ebab7e5d695c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Volume volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24 (d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24): created successfully Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193e748a-08ac-4fac-90c0-ebab7e5d695c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Flow 'volume_create_manager' (dd2962ae-43f1-4149-ab20-1b801c2a1ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:44 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-63c0ad00-2278-4e1b-9abb-c65d10ef7208 tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Created volume successfully. Jul 21 19:12:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-791e0db9-64da-481c-a5e5-01c13bb5e7f3 req-806a3baf-0776-402c-aa6d-881c5977408b tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-791e0db9-64da-481c-a5e5-01c13bb5e7f3 req-806a3baf-0776-402c-aa6d-881c5977408b tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-791e0db9-64da-481c-a5e5-01c13bb5e7f3 req-806a3baf-0776-402c-aa6d-881c5977408b tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-791e0db9-64da-481c-a5e5-01c13bb5e7f3 req-806a3baf-0776-402c-aa6d-881c5977408b tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31392a85-286d-407b-9bb7-4b0c72b14aa9', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:12:45 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-791e0db9-64da-481c-a5e5-01c13bb5e7f3 req-806a3baf-0776-402c-aa6d-881c5977408b tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] attachment_update completed successfully. Jul 21 19:12:47 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-bd10de6d-3d7f-4bf2-b8b7-1007108900b5 req-1eda7f87-27f2-4c23-98ad-54fd3f24482e tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Terminate volume connection completed successfully. Jul 21 19:12:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-bd10de6d-3d7f-4bf2-b8b7-1007108900b5 req-1eda7f87-27f2-4c23-98ad-54fd3f24482e tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Deleting attachment 31392a85-286d-407b-9bb7-4b0c72b14aa9. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:12:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Acquiring lock "cinder-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Lock "cinder-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Acquiring lock "cinder-quobyte-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Lock "cinder-quobyte-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:49 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa21529-7766-4b1f-a0a0-7ed0309f419d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:49 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24 Jul 21 19:12:49 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:49 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24" returned: 0 in 0.393s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:49 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24 Jul 21 19:12:49 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:49 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24" returned: 0 in 0.255s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Lock "cinder-quobyte-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24" released by "delete_volume" :: held 0.689s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:49 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Created reservations ['fef94cac-eba3-4c75-8485-5860108c4dfd', '8bffc51d-7305-4dd1-9a32-2e2dd79a7905', '3785017c-149d-406a-b9c8-3bbea4dd8b3f', '83d7a73e-7585-425f-88b2-31af29f9d0c9'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:49 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:12:49 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:50 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.289s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:50 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:50 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Deleted volume successfully. Jul 21 19:12:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e90c5bb4-24de-45a6-8028-a3fa535a128d tempest-TestServerVolumeAttachScenarioOldVersion-1472426857 None] Lock "cinder-d4c4ecfd-59bc-4537-ba40-5ce5a1f4de24-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Flow 'volume_create_manager' (90ee8eee-49d4-4e8a-9777-ef6d709730a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8b9d10-5fd7-4d66-a300-883f4f7f507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8b9d10-5fd7-4d66-a300-883f4f7f507f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1118493476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed963a29-d97e-404f-b306-ab46ecd8266c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4746159189d417d8ffa41e7cc25fc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:54Z,use_quota=True,user_id='6b14f6e02a5a4c7bb4b11f933b57d53d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb44e181-a235-46fb-b0eb-819a7a0c01a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb44e181-a235-46fb-b0eb-819a7a0c01a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e6e8d5-ce4b-4e9b-9537-4a7d998f64d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e6e8d5-ce4b-4e9b-9537-4a7d998f64d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed963a29-d97e-404f-b306-ab46ecd8266c', 'volume_name': 'volume-ed963a29-d97e-404f-b306-ab46ecd8266c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c5dd09-87ca-44a3-b9ed-ad4dc49556d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c5dd09-87ca-44a3-b9ed-ad4dc49556d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38bb03b-2552-4889-8363-ad5ddf251f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:53 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Volume ed963a29-d97e-404f-b306-ab46ecd8266c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed963a29-d97e-404f-b306-ab46ecd8266c', 'volume_size': 1} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1118493476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed963a29-d97e-404f-b306-ab46ecd8266c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4746159189d417d8ffa41e7cc25fc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:54Z,use_quota=True,user_id='6b14f6e02a5a4c7bb4b11f933b57d53d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Creating volume ed963a29-d97e-404f-b306-ab46ecd8266c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:53 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:12:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed963a29-d97e-404f-b306-ab46ecd8266c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:53 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed963a29-d97e-404f-b306-ab46ecd8266c 1073741824 Jul 21 19:12:53 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:54 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed963a29-d97e-404f-b306-ab46ecd8266c 1073741824" returned: 0 in 0.578s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed963a29-d97e-404f-b306-ab46ecd8266c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:54 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed963a29-d97e-404f-b306-ab46ecd8266c Jul 21 19:12:54 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:54 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed963a29-d97e-404f-b306-ab46ecd8266c" returned: 0 in 0.274s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38bb03b-2552-4889-8363-ad5ddf251f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed963a29-d97e-404f-b306-ab46ecd8266c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da03bad-5811-42f3-b94c-8308adc22cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:54 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Volume volume-ed963a29-d97e-404f-b306-ab46ecd8266c (ed963a29-d97e-404f-b306-ab46ecd8266c): created successfully Jul 21 19:12:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da03bad-5811-42f3-b94c-8308adc22cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Flow 'volume_create_manager' (90ee8eee-49d4-4e8a-9777-ef6d709730a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:54 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-70f84e29-b63f-4da7-bf1b-1b2f3dd8bf20 tempest-AttachVolumeNegativeTest-37116685 None] Created volume successfully. Jul 21 19:12:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-d0eadde8-646b-4e69-afc8-1d025f54b14d req-d3f3b939-6c15-4b19-9f52-521daedc84da tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-d0eadde8-646b-4e69-afc8-1d025f54b14d req-d3f3b939-6c15-4b19-9f52-521daedc84da tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-d0eadde8-646b-4e69-afc8-1d025f54b14d req-d3f3b939-6c15-4b19-9f52-521daedc84da tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-d0eadde8-646b-4e69-afc8-1d025f54b14d req-d3f3b939-6c15-4b19-9f52-521daedc84da tempest-AttachVolumeNegativeTest-37116685 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-ed963a29-d97e-404f-b306-ab46ecd8266c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfde1d2a-b3b1-429f-b6f4-5d56d6d9d7d6', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:12:56 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-d0eadde8-646b-4e69-afc8-1d025f54b14d req-d3f3b939-6c15-4b19-9f52-521daedc84da tempest-AttachVolumeNegativeTest-37116685 None] attachment_update completed successfully. Jul 21 19:12:58 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-53a29f87-861b-4a49-9267-86d23eca7a82 req-ddd28fda-d85d-4fd4-9f0a-47cf1e598f52 tempest-AttachVolumeNegativeTest-37116685 None] Terminate volume connection completed successfully. Jul 21 19:12:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-53a29f87-861b-4a49-9267-86d23eca7a82 req-ddd28fda-d85d-4fd4-9f0a-47cf1e598f52 tempest-AttachVolumeNegativeTest-37116685 None] Deleting attachment cfde1d2a-b3b1-429f-b6f4-5d56d6d9d7d6. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:13:06 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=31,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:13:08 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=33,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:13:20 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-aff9dd60-f52a-4530-b9b9-15ffc7fd2cdf tempest-TestShelveInstance-1384022846 None] Terminate volume connection completed successfully. Jul 21 19:13:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-aff9dd60-f52a-4530-b9b9-15ffc7fd2cdf tempest-TestShelveInstance-1384022846 None] Deleting attachment 787517f5-01f4-4bd9-9c77-05f8678d3216. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:13:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Acquiring lock "cinder-1a7481e8-b262-4845-a73d-5bd533363f94-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Lock "cinder-1a7481e8-b262-4845-a73d-5bd533363f94-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Acquiring lock "cinder-quobyte-1a7481e8-b262-4845-a73d-5bd533363f94" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Lock "cinder-quobyte-1a7481e8-b262-4845-a73d-5bd533363f94" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:21 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1665c515-b4e1-4aca-8eac-44072ec68649]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:21 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 Jul 21 19:13:21 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:21 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94" returned: 0 in 0.523s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:21 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94 Jul 21 19:13:21 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:22 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1a7481e8-b262-4845-a73d-5bd533363f94" returned: 0 in 0.338s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Lock "cinder-quobyte-1a7481e8-b262-4845-a73d-5bd533363f94" released by "delete_volume" :: held 0.972s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:22 devstack cinder-volume[87487]: DEBUG cinder.quota [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Created reservations ['d7762841-62cd-4b3d-8a29-22875b600727', '2d57c8d2-67be-457c-a02b-97e01a077f8f', '0c255953-825e-4fa6-a148-8056be798a09', '0219c3c7-e02f-4f7d-9e44-6f4d2859a4e2'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:22 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:13:22 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:22 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.476s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:22 devstack cinder-volume[87487]: DEBUG cinder.manager [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:22 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Deleted volume successfully. Jul 21 19:13:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-8ffb90b5-e5a6-4bb8-8f86-a58c69461f7b req-cf33c7f7-d4f7-4932-84c5-955f5cd58175 tempest-TestShelveInstance-1384022846 None] Lock "cinder-1a7481e8-b262-4845-a73d-5bd533363f94-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Flow 'volume_create_manager' (feab21dc-ed67-44e2-b250-2f87b9fa2ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115dbe02-af95-41b3-8bc7-6c4a9f1a440a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115dbe02-af95-41b3-8bc7-6c4a9f1a440a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1759426816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ad96e3-990b-406a-af6e-3685519a96e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6219ce7e685747338511f0843a526b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:31Z,use_quota=True,user_id='9b509d04c6c44feb81d6a0cb44b47c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33d58b8-9275-4ab4-acf5-e0e0b41f693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33d58b8-9275-4ab4-acf5-e0e0b41f693e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7031163c-fe3f-4a2a-bb0e-2bdc3af57e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7031163c-fe3f-4a2a-bb0e-2bdc3af57e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ad96e3-990b-406a-af6e-3685519a96e8', 'volume_name': 'volume-f4ad96e3-990b-406a-af6e-3685519a96e8', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0feead-3b03-4c1c-86ee-6602d70d198e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0feead-3b03-4c1c-86ee-6602d70d198e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989f7a50-aa87-4268-839f-ab2bf687d544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:30 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Volume f4ad96e3-990b-406a-af6e-3685519a96e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ad96e3-990b-406a-af6e-3685519a96e8', 'volume_size': 1} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1759426816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ad96e3-990b-406a-af6e-3685519a96e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6219ce7e685747338511f0843a526b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:31Z,use_quota=True,user_id='9b509d04c6c44feb81d6a0cb44b47c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Creating volume f4ad96e3-990b-406a-af6e-3685519a96e8 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:31 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f4ad96e3-990b-406a-af6e-3685519a96e8 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:31 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f4ad96e3-990b-406a-af6e-3685519a96e8 1073741824 Jul 21 19:13:31 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Flow 'volume_create_manager' (d0b68954-a012-4950-afb7-4905e7f0bdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eed1ee4-511b-4a06-b20f-efcf910f0142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eed1ee4-511b-4a06-b20f-efcf910f0142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-35393618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1376dd-64fd-415b-aa09-5e76f04fcf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6219ce7e685747338511f0843a526b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:31Z,use_quota=True,user_id='9b509d04c6c44feb81d6a0cb44b47c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271477b1-47d7-42b5-8ec7-91ecab6e7ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271477b1-47d7-42b5-8ec7-91ecab6e7ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9525c74-82cb-4805-90ac-3453abcaf77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9525c74-82cb-4805-90ac-3453abcaf77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea1376dd-64fd-415b-aa09-5e76f04fcf15', 'volume_name': 'volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84eb6aa-c559-42c2-b7ff-e930dabc95e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84eb6aa-c559-42c2-b7ff-e930dabc95e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a90764-ae4f-4df2-9336-4e6ec8bfe8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:31 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Volume ea1376dd-64fd-415b-aa09-5e76f04fcf15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15', 'volume_size': 1} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:31 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f4ad96e3-990b-406a-af6e-3685519a96e8 1073741824" returned: 0 in 0.679s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f4ad96e3-990b-406a-af6e-3685519a96e8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:31 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f4ad96e3-990b-406a-af6e-3685519a96e8 Jul 21 19:13:31 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:32 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f4ad96e3-990b-406a-af6e-3685519a96e8" returned: 0 in 0.296s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.575s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-35393618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1376dd-64fd-415b-aa09-5e76f04fcf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6219ce7e685747338511f0843a526b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:31Z,use_quota=True,user_id='9b509d04c6c44feb81d6a0cb44b47c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Creating volume ea1376dd-64fd-415b-aa09-5e76f04fcf15 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:32 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989f7a50-aa87-4268-839f-ab2bf687d544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ad96e3-990b-406a-af6e-3685519a96e8', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d499cb37-8c62-4857-babe-33a9358830bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:32 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15 1073741824 Jul 21 19:13:32 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:32 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Volume volume-f4ad96e3-990b-406a-af6e-3685519a96e8 (f4ad96e3-990b-406a-af6e-3685519a96e8): created successfully Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d499cb37-8c62-4857-babe-33a9358830bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Flow 'volume_create_manager' (feab21dc-ed67-44e2-b250-2f87b9fa2ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:32 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-7d88ad37-122c-4df4-b3af-84a36dca57aa tempest-TestServerVolumeAttachmentScenario-893452271 None] Created volume successfully. Jul 21 19:13:32 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15 1073741824" returned: 0 in 0.584s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:32 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15 Jul 21 19:13:32 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:32 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15" returned: 0 in 0.301s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:32 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a90764-ae4f-4df2-9336-4e6ec8bfe8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034a51b6-ab3f-4a82-9322-019f095fa134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:33 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Volume volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15 (ea1376dd-64fd-415b-aa09-5e76f04fcf15): created successfully Jul 21 19:13:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034a51b6-ab3f-4a82-9322-019f095fa134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Flow 'volume_create_manager' (d0b68954-a012-4950-afb7-4905e7f0bdec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:33 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5908cdbf-0dcb-4192-90a0-cfe67904aeeb tempest-TestServerVolumeAttachmentScenario-893452271 None] Created volume successfully. Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Flow 'volume_create_manager' (2c179f0a-d38e-4a71-8984-e8ef46f266db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3d33c8-c70a-4f58-bfad-13aa1f3a088b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3d33c8-c70a-4f58-bfad-13aa1f3a088b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-389921030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1dac84-a12f-4fdc-84b9-6dfb2229703c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4746159189d417d8ffa41e7cc25fc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:37Z,use_quota=True,user_id='6b14f6e02a5a4c7bb4b11f933b57d53d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186db7f5-63d2-407b-b25f-88b072a59cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186db7f5-63d2-407b-b25f-88b072a59cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62384ef-82ec-4463-b8cc-406889b25d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62384ef-82ec-4463-b8cc-406889b25d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1dac84-a12f-4fdc-84b9-6dfb2229703c', 'volume_name': 'volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a227027e-b161-4fc6-afa1-c06b53048709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a227027e-b161-4fc6-afa1-c06b53048709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf87dc3-4ba8-4e37-a96f-0a6415ad06e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:37 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Volume 4e1dac84-a12f-4fdc-84b9-6dfb2229703c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c', 'volume_size': 1} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-389921030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1dac84-a12f-4fdc-84b9-6dfb2229703c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4746159189d417d8ffa41e7cc25fc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:37Z,use_quota=True,user_id='6b14f6e02a5a4c7bb4b11f933b57d53d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Creating volume 4e1dac84-a12f-4fdc-84b9-6dfb2229703c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:37 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:13:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:37 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c 1073741824 Jul 21 19:13:37 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:38 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c 1073741824" returned: 0 in 0.549s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:38 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c Jul 21 19:13:38 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:38 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c" returned: 0 in 0.348s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf87dc3-4ba8-4e37-a96f-0a6415ad06e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25204487-8c58-4b24-b598-af5454d4b53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:38 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Volume volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c (4e1dac84-a12f-4fdc-84b9-6dfb2229703c): created successfully Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25204487-8c58-4b24-b598-af5454d4b53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Flow 'volume_create_manager' (2c179f0a-d38e-4a71-8984-e8ef46f266db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:38 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-1d98a24e-dcb2-4a78-8bba-634517702e25 tempest-AttachVolumeNegativeTest-37116685 None] Created volume successfully. Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Flow 'volume_create_manager' (2044b54e-12f7-41ff-b878-c6ebf5aae1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e65abd5-72bd-43d0-9546-9e0d3855fc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e65abd5-72bd-43d0-9546-9e0d3855fc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765ea56e-a271-4b91-ad54-c5d19cf4fd57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82211514a3824058999eb04ccf5be5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:39Z,use_quota=True,user_id='e5270f717f814cc990202601e75fd7b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc0a481-990d-4bc9-b580-44e56bc3dc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc0a481-990d-4bc9-b580-44e56bc3dc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0045cd-2b49-43e9-b7c6-e357c35cb387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:38 devstack cinder-volume[87487]: DEBUG cinder.image.glance [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Creating Keystone auth plugin from conf {{(pid=87487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:13:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0045cd-2b49-43e9-b7c6-e357c35cb387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '765ea56e-a271-4b91-ad54-c5d19cf4fd57', 'volume_name': 'volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57', 'volume_size': 1, 'image_id': 'dbc8263c-4339-4eb1-8240-7f3620875290', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbc8263c-4339-4eb1-8240-7f3620875290', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e23eb7966325f417ce12fb0571c9b77', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82211514a3824058999eb04ccf5be5e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '676bf4683c2692ad74619fa10d2517b5bd353457d7c13a5dbfe9fd5ca90ea4c45452b61299d02f2c096bcb264468a11120e2ea0643177c8cfebee06c6276bae3', 'id': 'dbc8263c-4339-4eb1-8240-7f3620875290', 'created_at': datetime.datetime(2026, 7, 21, 17, 13, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 13, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbc8263c-4339-4eb1-8240-7f3620875290/file', 'properties': {}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87488e4-ed6a-433c-bf74-b20e373f461c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87488e4-ed6a-433c-bf74-b20e373f461c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77ec252-1a6c-4d46-a1eb-080bedd385d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:39 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Volume 765ea56e-a271-4b91-ad54-c5d19cf4fd57: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57', 'volume_size': 1, 'image_id': 'dbc8263c-4339-4eb1-8240-7f3620875290', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbc8263c-4339-4eb1-8240-7f3620875290', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e23eb7966325f417ce12fb0571c9b77', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82211514a3824058999eb04ccf5be5e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '676bf4683c2692ad74619fa10d2517b5bd353457d7c13a5dbfe9fd5ca90ea4c45452b61299d02f2c096bcb264468a11120e2ea0643177c8cfebee06c6276bae3', 'id': 'dbc8263c-4339-4eb1-8240-7f3620875290', 'created_at': datetime.datetime(2026, 7, 21, 17, 13, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 13, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbc8263c-4339-4eb1-8240-7f3620875290/file', 'properties': {}}, 'image_service': } Jul 21 19:13:39 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Trying to clone 765ea56e-a271-4b91-ad54-c5d19cf4fd57 from image dbc8263c-4339-4eb1-8240-7f3620875290 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dbc8263c-4339-4eb1-8240-7f3620875290', 'metadata': {}}]). {{(pid=87487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:13:39 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:13:39 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Image download 0.00 MB at 0.00 MB/s Jul 21 19:13:39 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c124c11-4b63-4cd5-a7e4-4ad3b878a987]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:39 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD Jul 21 19:13:39 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:39 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD" returned: 0 in 0.611s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:40 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD Jul 21 19:13:40 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:40 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD" returned: 1 in 0.493s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Temporary image dbc8263c-4339-4eb1-8240-7f3620875290 is fetched for user e5270f717f814cc990202601e75fd7b0. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7853c-6e21-42eb-abc3-01af69ea1bb9]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:40 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:13:40 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-0e58999c-c299-43be-8da9-ecba08a7a424 req-394f491f-c0db-480d-b888-72db9f695687 tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-0e58999c-c299-43be-8da9-ecba08a7a424 req-394f491f-c0db-480d-b888-72db9f695687 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-0e58999c-c299-43be-8da9-ecba08a7a424 req-394f491f-c0db-480d-b888-72db9f695687 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:40 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD Jul 21 19:13:40 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-0e58999c-c299-43be-8da9-ecba08a7a424 req-394f491f-c0db-480d-b888-72db9f695687 tempest-AttachVolumeNegativeTest-37116685 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a1366ba-738f-4ccd-ae15-27ec966a39df', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:13:40 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-0e58999c-c299-43be-8da9-ecba08a7a424 req-394f491f-c0db-480d-b888-72db9f695687 tempest-AttachVolumeNegativeTest-37116685 None] attachment_update completed successfully. Jul 21 19:13:41 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD" returned: 0 in 0.539s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:41 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.484s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:13:41 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD Jul 21 19:13:41 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:41 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD" returned: 1 in 0.470s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765ea56e-a271-4b91-ad54-c5d19cf4fd57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82211514a3824058999eb04ccf5be5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:39Z,use_quota=True,user_id='e5270f717f814cc990202601e75fd7b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Creating volume 765ea56e-a271-4b91-ad54-c5d19cf4fd57 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:41 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:13:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:41 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 1073741824 Jul 21 19:13:41 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:42 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 1073741824" returned: 0 in 0.605s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:42 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 Jul 21 19:13:42 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:42 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57" returned: 0 in 0.313s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:42 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:42 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Attempting download of dbc8263c-4339-4eb1-8240-7f3620875290 ((None, [{'url': 'file:///opt/stack/data/glance/images/dbc8263c-4339-4eb1-8240-7f3620875290', 'metadata': {}}])) to volume 765ea56e-a271-4b91-ad54-c5d19cf4fd57. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:13:42 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[558baa38-ab1c-400f-8097-8a8d7af5f6e6]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbc8263c-4339-4eb1-8240-7f3620875290_v9kfhlp_ {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:42 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbc8263c-4339-4eb1-8240-7f3620875290_v9kfhlp_ Jul 21 19:13:42 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:43 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbc8263c-4339-4eb1-8240-7f3620875290_v9kfhlp_" returned: 0 in 0.521s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbc8263c-4339-4eb1-8240-7f3620875290_v9kfhlp_ {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:43 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbc8263c-4339-4eb1-8240-7f3620875290_v9kfhlp_ Jul 21 19:13:43 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:43 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbc8263c-4339-4eb1-8240-7f3620875290_v9kfhlp_" returned: 1 in 0.436s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbc8263c-4339-4eb1-8240-7f3620875290_v9kfhlp_' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:13:43 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[15510002-254b-4c8f-8c64-0065feef092a]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:43 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-45e96954-12e4-49fe-b39e-d7fd3165be5e req-1d1f3aec-e9e4-4ef1-a23b-22f0707a7985 tempest-AttachVolumeNegativeTest-37116685 None] Terminate volume connection completed successfully. Jul 21 19:13:43 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-45e96954-12e4-49fe-b39e-d7fd3165be5e req-1d1f3aec-e9e4-4ef1-a23b-22f0707a7985 tempest-AttachVolumeNegativeTest-37116685 None] Deleting attachment 1a1366ba-738f-4ccd-ae15-27ec966a39df. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:13:43 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD Jul 21 19:13:43 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:44 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:44 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD Jul 21 19:13:44 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:44 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:13:44 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] dbc8263c-4339-4eb1-8240-7f3620875290 was raw, converting to qcow2 {{(pid=87487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:13:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:44 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 Jul 21 19:13:44 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:44 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57" returned: 0 in 0.523s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:45 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dbc8263c-4339-4eb1-8240-7f3620875290_5onc1drvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:13:45 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 19:13:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:45 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 1G Jul 21 19:13:45 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:45 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 1G" returned: 0 in 0.662s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:45 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Downloaded image dbc8263c-4339-4eb1-8240-7f3620875290 ((None, [{'url': 'file:///opt/stack/data/glance/images/dbc8263c-4339-4eb1-8240-7f3620875290', 'metadata': {}}])) to volume 765ea56e-a271-4b91-ad54-c5d19cf4fd57 successfully. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:13:45 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Temporary image dbc8263c-4339-4eb1-8240-7f3620875290 for user e5270f717f814cc990202601e75fd7b0 is deleted. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:13:45 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Marking volume 765ea56e-a271-4b91-ad54-c5d19cf4fd57 as bootable. {{(pid=87487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:13:45 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Copying metadata from image dbc8263c-4339-4eb1-8240-7f3620875290 to 765ea56e-a271-4b91-ad54-c5d19cf4fd57. {{(pid=87487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:13:45 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Creating volume glance metadata for volume 765ea56e-a271-4b91-ad54-c5d19cf4fd57 backed by image dbc8263c-4339-4eb1-8240-7f3620875290 with: {'image_id': 'dbc8263c-4339-4eb1-8240-7f3620875290', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4e23eb7966325f417ce12fb0571c9b77', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:13:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77ec252-1a6c-4d46-a1eb-080bedd385d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57', 'volume_size': 1, 'image_id': 'dbc8263c-4339-4eb1-8240-7f3620875290', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbc8263c-4339-4eb1-8240-7f3620875290', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e23eb7966325f417ce12fb0571c9b77', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82211514a3824058999eb04ccf5be5e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '676bf4683c2692ad74619fa10d2517b5bd353457d7c13a5dbfe9fd5ca90ea4c45452b61299d02f2c096bcb264468a11120e2ea0643177c8cfebee06c6276bae3', 'id': 'dbc8263c-4339-4eb1-8240-7f3620875290', 'created_at': datetime.datetime(2026, 7, 21, 17, 13, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 13, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbc8263c-4339-4eb1-8240-7f3620875290/file', 'properties': {}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17fe6f61-1df7-4fdb-a9ed-4a565c097786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:45 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Volume volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 (765ea56e-a271-4b91-ad54-c5d19cf4fd57): created successfully Jul 21 19:13:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17fe6f61-1df7-4fdb-a9ed-4a565c097786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Flow 'volume_create_manager' (2044b54e-12f7-41ff-b878-c6ebf5aae1ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:45 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-48a1e6be-b7c6-4bcd-9841-390de3f7dd4d tempest-VolumeImageDependencyTests-601764353 None] Created volume successfully. Jul 21 19:13:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Acquiring lock "cinder-765ea56e-a271-4b91-ad54-c5d19cf4fd57-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Lock "cinder-765ea56e-a271-4b91-ad54-c5d19cf4fd57-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Acquiring lock "cinder-quobyte-765ea56e-a271-4b91-ad54-c5d19cf4fd57" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Lock "cinder-quobyte-765ea56e-a271-4b91-ad54-c5d19cf4fd57" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:46 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dfe93e-4381-40d0-908b-8a6a9763ccfb]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:46 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 Jul 21 19:13:46 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:47 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57" returned: 0 in 0.415s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:47 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57 Jul 21 19:13:47 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:47 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-765ea56e-a271-4b91-ad54-c5d19cf4fd57" returned: 0 in 0.267s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Lock "cinder-quobyte-765ea56e-a271-4b91-ad54-c5d19cf4fd57" released by "delete_volume" :: held 0.762s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:47 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Created reservations ['6af5fc82-d063-4739-8364-66ff65d3ba9d', '2ac848aa-6a65-4599-a279-9b4c435b2ccd', '073d422f-62c3-482d-9887-2d8923bea138', '245128a1-e47b-456c-a59c-e0d97e10291f'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:47 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:13:47 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:48 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.478s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:48 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:48 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Deleted volume successfully. Jul 21 19:13:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4ba5635d-5720-4825-9927-bfb63ef5460e tempest-VolumeImageDependencyTests-601764353 None] Lock "cinder-765ea56e-a271-4b91-ad54-c5d19cf4fd57-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "cinder-4e1dac84-a12f-4fdc-84b9-6dfb2229703c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Lock "cinder-4e1dac84-a12f-4fdc-84b9-6dfb2229703c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "cinder-quobyte-4e1dac84-a12f-4fdc-84b9-6dfb2229703c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Lock "cinder-quobyte-4e1dac84-a12f-4fdc-84b9-6dfb2229703c" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:48 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf7bd97-3542-420f-9e3a-25fab06e7ca7]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:48 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c Jul 21 19:13:48 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:49 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c" returned: 0 in 0.406s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:49 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c Jul 21 19:13:49 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:49 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4e1dac84-a12f-4fdc-84b9-6dfb2229703c" returned: 0 in 0.283s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Lock "cinder-quobyte-4e1dac84-a12f-4fdc-84b9-6dfb2229703c" released by "delete_volume" :: held 0.736s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:49 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Created reservations ['9c447e8b-3bd0-4829-9f4d-e5ba36de9696', '47ce64eb-e571-4e1e-bacf-3adce0619d5f', '56acdd9f-dfe1-405d-9b6d-9ce4c00bafa0', 'ed971e78-4680-46bf-b276-5ca0704c89bd'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:49 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:13:49 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:50 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.325s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:50 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:50 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Deleted volume successfully. Jul 21 19:13:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2e74a897-10e1-436d-84c5-dd761f856c10 tempest-AttachVolumeNegativeTest-37116685 None] Lock "cinder-4e1dac84-a12f-4fdc-84b9-6dfb2229703c-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "cinder-ed963a29-d97e-404f-b306-ab46ecd8266c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Lock "cinder-ed963a29-d97e-404f-b306-ab46ecd8266c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "cinder-quobyte-ed963a29-d97e-404f-b306-ab46ecd8266c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Lock "cinder-quobyte-ed963a29-d97e-404f-b306-ab46ecd8266c" acquired by "delete_volume" :: waited 0.035s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:50 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afba8a9-1ca1-4a3d-a8fc-78e26ef286a5]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed963a29-d97e-404f-b306-ab46ecd8266c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:50 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed963a29-d97e-404f-b306-ab46ecd8266c Jul 21 19:13:50 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:50 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed963a29-d97e-404f-b306-ab46ecd8266c" returned: 0 in 0.392s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed963a29-d97e-404f-b306-ab46ecd8266c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:50 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed963a29-d97e-404f-b306-ab46ecd8266c Jul 21 19:13:50 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:50 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed963a29-d97e-404f-b306-ab46ecd8266c" returned: 0 in 0.276s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Lock "cinder-quobyte-ed963a29-d97e-404f-b306-ab46ecd8266c" released by "delete_volume" :: held 0.715s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Created reservations ['173a6cb0-4bbd-4e11-ad81-5aa6e40495fa', 'a509ba72-9410-4598-8dec-6466fb9a4564', '4eefcfff-445c-46da-b2c0-c56a374394d5', 'be0419b2-a0cd-4d43-a28a-e717a1c80b6e'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:51 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:13:51 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:51 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.302s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:51 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Deleted volume successfully. Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-231c4ae8-9104-4b8f-b431-f039abe9e50b tempest-AttachVolumeNegativeTest-37116685 None] Lock "cinder-ed963a29-d97e-404f-b306-ab46ecd8266c-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "cinder-6f194354-f9fe-4403-b8a8-11258544ff17-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Lock "cinder-6f194354-f9fe-4403-b8a8-11258544ff17-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "cinder-quobyte-6f194354-f9fe-4403-b8a8-11258544ff17" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Lock "cinder-quobyte-6f194354-f9fe-4403-b8a8-11258544ff17" acquired by "delete_volume" :: waited 0.014s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecefd2a-c6d8-42e0-969c-28f7893f9276]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f194354-f9fe-4403-b8a8-11258544ff17 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:51 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f194354-f9fe-4403-b8a8-11258544ff17 Jul 21 19:13:51 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:52 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f194354-f9fe-4403-b8a8-11258544ff17" returned: 0 in 0.390s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f194354-f9fe-4403-b8a8-11258544ff17 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:52 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f194354-f9fe-4403-b8a8-11258544ff17 Jul 21 19:13:52 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:52 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6f194354-f9fe-4403-b8a8-11258544ff17" returned: 0 in 0.315s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Lock "cinder-quobyte-6f194354-f9fe-4403-b8a8-11258544ff17" released by "delete_volume" :: held 0.772s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:52 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Created reservations ['bf98fd0e-970c-4e3b-8a76-582258702a3e', '393f1aa7-2a96-4a4f-adcd-a35a98a0d2d8', 'cb9e8003-ccab-45d1-9c28-fa9baefccb7a', '3f68a628-5281-445b-93f3-b1bc8873a758'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:52 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:13:52 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:53 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.355s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:53 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:53 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Deleted volume successfully. Jul 21 19:13:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-82f106bb-444c-491d-9d0b-0a9f150d7d52 tempest-AttachVolumeNegativeTest-37116685 None] Lock "cinder-6f194354-f9fe-4403-b8a8-11258544ff17-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Flow 'volume_create_manager' (e3640d16-637b-48bd-8985-84e82a289dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9feb691b-ace2-4b1a-be10-91d4c0e9b011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9feb691b-ace2-4b1a-be10-91d4c0e9b011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1170372516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7726f7d5-da65-48f7-9b09-f8174fa42c4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9af21956f2c34500993ef5ac8651a5e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:00Z,use_quota=True,user_id='a6f4d7b396144daf9fc396986adc566c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804127a3-919c-4bc4-af49-f307bc25e64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804127a3-919c-4bc4-af49-f307bc25e64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17662a88-dfdb-44a0-bf96-56478330570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17662a88-dfdb-44a0-bf96-56478330570d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7726f7d5-da65-48f7-9b09-f8174fa42c4b', 'volume_name': 'volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e82c64-edbe-492b-82d4-8e3d24277a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e82c64-edbe-492b-82d4-8e3d24277a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02764b22-f7e9-44a4-87eb-da91b95ff21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:00 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Volume 7726f7d5-da65-48f7-9b09-f8174fa42c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b', 'volume_size': 1} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1170372516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7726f7d5-da65-48f7-9b09-f8174fa42c4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9af21956f2c34500993ef5ac8651a5e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:00Z,use_quota=True,user_id='a6f4d7b396144daf9fc396986adc566c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Creating volume 7726f7d5-da65-48f7-9b09-f8174fa42c4b {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:00 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:00 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b 1073741824 Jul 21 19:14:00 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:00 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b 1073741824" returned: 0 in 0.481s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:00 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b Jul 21 19:14:00 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:01 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b" returned: 0 in 0.283s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02764b22-f7e9-44a4-87eb-da91b95ff21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14b8778-fbcf-4fde-bccf-635e9182825e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:01 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Volume volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b (7726f7d5-da65-48f7-9b09-f8174fa42c4b): created successfully Jul 21 19:14:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14b8778-fbcf-4fde-bccf-635e9182825e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Flow 'volume_create_manager' (e3640d16-637b-48bd-8985-84e82a289dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:01 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-730e7447-ded9-47d4-a5a7-242097c9907f req-c982a470-0eda-4bb2-8532-39674b70c7de tempest-VolumesGetTestJSON-1818931162 None] Created volume successfully. Jul 21 19:14:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Acquiring lock "cinder-7726f7d5-da65-48f7-9b09-f8174fa42c4b-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Lock "cinder-7726f7d5-da65-48f7-9b09-f8174fa42c4b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Acquiring lock "cinder-quobyte-7726f7d5-da65-48f7-9b09-f8174fa42c4b" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Lock "cinder-quobyte-7726f7d5-da65-48f7-9b09-f8174fa42c4b" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:01 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8c224c-7ddb-4274-b255-63f0f142428a]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:01 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b Jul 21 19:14:01 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:02 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b" returned: 0 in 0.456s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:02 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b Jul 21 19:14:02 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:02 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7726f7d5-da65-48f7-9b09-f8174fa42c4b" returned: 0 in 0.294s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Lock "cinder-quobyte-7726f7d5-da65-48f7-9b09-f8174fa42c4b" released by "delete_volume" :: held 0.808s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:02 devstack cinder-volume[87487]: DEBUG cinder.quota [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Created reservations ['cff6a451-1a9a-479a-88a3-7bb058eff3f1', 'c4a10679-f9e1-4a49-8e20-ae0c6fbb62d0', 'e13bc64e-60ac-4711-b932-083b64879023', '4199bc8c-7287-44c2-826e-36b92357c44c'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:02 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:14:02 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:03 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.449s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:03 devstack cinder-volume[87487]: DEBUG cinder.manager [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:03 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Deleted volume successfully. Jul 21 19:14:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [req-62ef6c4a-72f3-4b02-ba26-4df74b097d02 req-38a9a293-3bc8-481c-910e-5ffeac2a7329 tempest-VolumesGetTestJSON-1818931162 None] Lock "cinder-7726f7d5-da65-48f7-9b09-f8174fa42c4b-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-20234177-cf36-41ea-94c8-8c0aeaebbff9 req-a97d9e40-fefe-41c0-99d6-10fb0054f82a tempest-TestServerVolumeAttachmentScenario-893452271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-20234177-cf36-41ea-94c8-8c0aeaebbff9 req-a97d9e40-fefe-41c0-99d6-10fb0054f82a tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-20234177-cf36-41ea-94c8-8c0aeaebbff9 req-a97d9e40-fefe-41c0-99d6-10fb0054f82a tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-20234177-cf36-41ea-94c8-8c0aeaebbff9 req-a97d9e40-fefe-41c0-99d6-10fb0054f82a tempest-TestServerVolumeAttachmentScenario-893452271 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-f4ad96e3-990b-406a-af6e-3685519a96e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c3feec3-81bf-4094-9099-2ae9a91a8390', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:14:04 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-20234177-cf36-41ea-94c8-8c0aeaebbff9 req-a97d9e40-fefe-41c0-99d6-10fb0054f82a tempest-TestServerVolumeAttachmentScenario-893452271 None] attachment_update completed successfully. Jul 21 19:14:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-24577145-6d66-415b-a03c-b76db2d37283 req-093ea578-581c-4c07-95ad-bcc0f621f79f tempest-TestServerVolumeAttachmentScenario-893452271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-24577145-6d66-415b-a03c-b76db2d37283 req-093ea578-581c-4c07-95ad-bcc0f621f79f tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-24577145-6d66-415b-a03c-b76db2d37283 req-093ea578-581c-4c07-95ad-bcc0f621f79f tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-24577145-6d66-415b-a03c-b76db2d37283 req-093ea578-581c-4c07-95ad-bcc0f621f79f tempest-TestServerVolumeAttachmentScenario-893452271 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82ce6b5a-5cab-43c3-9669-54ce93e67caa', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:14:10 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-24577145-6d66-415b-a03c-b76db2d37283 req-093ea578-581c-4c07-95ad-bcc0f621f79f tempest-TestServerVolumeAttachmentScenario-893452271 None] attachment_update completed successfully. Jul 21 19:14:13 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-a320c0af-9e5d-4a32-a8cd-ab2c8505b3e4 req-450d708a-0936-431f-aaf2-f03c27ee57ca tempest-TestServerVolumeAttachmentScenario-893452271 None] Terminate volume connection completed successfully. Jul 21 19:14:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-a320c0af-9e5d-4a32-a8cd-ab2c8505b3e4 req-450d708a-0936-431f-aaf2-f03c27ee57ca tempest-TestServerVolumeAttachmentScenario-893452271 None] Deleting attachment 82ce6b5a-5cab-43c3-9669-54ce93e67caa. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:14:14 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-42b697e2-eb8a-4552-aa3c-67aa5ed965c0 req-44a075d2-81b3-4acc-8ab7-a1e78516c954 tempest-TestServerVolumeAttachmentScenario-893452271 None] Terminate volume connection completed successfully. Jul 21 19:14:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-42b697e2-eb8a-4552-aa3c-67aa5ed965c0 req-44a075d2-81b3-4acc-8ab7-a1e78516c954 tempest-TestServerVolumeAttachmentScenario-893452271 None] Deleting attachment 4c3feec3-81bf-4094-9099-2ae9a91a8390. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:14:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Acquiring lock "cinder-ea1376dd-64fd-415b-aa09-5e76f04fcf15-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "cinder-ea1376dd-64fd-415b-aa09-5e76f04fcf15-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:21 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=75,cinder:UPDATE=65,cinder:INSERT=21,cinder:DELETE=4 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:14:21 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=64,cinder:INSERT=17,cinder:UPDATE=74,cinder:DELETE=7 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:14:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Acquiring lock "cinder-quobyte-ea1376dd-64fd-415b-aa09-5e76f04fcf15" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "cinder-quobyte-ea1376dd-64fd-415b-aa09-5e76f04fcf15" acquired by "delete_volume" :: waited 0.035s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:21 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f8c164-513e-4b81-b6e4-42db3dde3bf8]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:21 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15 Jul 21 19:14:21 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:21 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15" returned: 0 in 0.507s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:21 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15 Jul 21 19:14:21 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:21 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea1376dd-64fd-415b-aa09-5e76f04fcf15" returned: 0 in 0.346s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "cinder-quobyte-ea1376dd-64fd-415b-aa09-5e76f04fcf15" released by "delete_volume" :: held 0.912s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Created reservations ['8856e980-c359-4e83-814f-bb6629d86a08', 'c8657922-9ee3-487b-b5d8-0416011403b0', '54c61822-5da3-4fcd-8e7b-6c676793f270', '3b3b5115-b97b-41bf-b16e-4364849e97ed'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:22 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:14:22 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Acquiring lock "cinder-f4ad96e3-990b-406a-af6e-3685519a96e8-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "cinder-f4ad96e3-990b-406a-af6e-3685519a96e8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Acquiring lock "cinder-quobyte-f4ad96e3-990b-406a-af6e-3685519a96e8" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "cinder-quobyte-f4ad96e3-990b-406a-af6e-3685519a96e8" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a673cd21-5803-449f-9798-6571f55037b5]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f4ad96e3-990b-406a-af6e-3685519a96e8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:22 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.395s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:22 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f4ad96e3-990b-406a-af6e-3685519a96e8 Jul 21 19:14:22 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:22 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Deleted volume successfully. Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-44b1b242-8538-4404-a13f-8dd9d6649d22 tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "cinder-ea1376dd-64fd-415b-aa09-5e76f04fcf15-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:22 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f4ad96e3-990b-406a-af6e-3685519a96e8" returned: 0 in 0.522s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f4ad96e3-990b-406a-af6e-3685519a96e8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:22 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f4ad96e3-990b-406a-af6e-3685519a96e8 Jul 21 19:14:22 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:23 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f4ad96e3-990b-406a-af6e-3685519a96e8" returned: 0 in 0.323s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "cinder-quobyte-f4ad96e3-990b-406a-af6e-3685519a96e8" released by "delete_volume" :: held 0.906s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:23 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Created reservations ['259835bb-9667-4cf7-88ac-047ae78095a2', '94e219d4-b4c9-442e-beae-37409ae62d5a', 'cd030a8c-a34d-4fd2-a0c9-87eea7e9d915', '06f25b1d-032c-4e6e-8fab-b52307d723af'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:23 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:14:23 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:23 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.311s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:23 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:23 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Deleted volume successfully. Jul 21 19:14:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fecbe10b-aae5-44fc-a1a0-e437f7e38b61 tempest-TestServerVolumeAttachmentScenario-893452271 None] Lock "cinder-f4ad96e3-990b-406a-af6e-3685519a96e8-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Flow 'volume_create_manager' (45687e46-3c48-437e-833f-f7ac98f2a8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ee9ca9-60e6-476d-a5fa-477787e63c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ee9ca9-60e6-476d-a5fa-477787e63c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1543890661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c91411-b869-436e-be43-c8dab76432f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e1e8411741249578e9777daf55677f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:28Z,use_quota=True,user_id='4c696144296e4144932b399461c341aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf13835-431c-4c26-8f1c-56fce8f2669d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf13835-431c-4c26-8f1c-56fce8f2669d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e43c20-c4fd-4c5e-a228-f36f5958c053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e43c20-c4fd-4c5e-a228-f36f5958c053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c91411-b869-436e-be43-c8dab76432f2', 'volume_name': 'volume-23c91411-b869-436e-be43-c8dab76432f2', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67133b6-da47-468f-808b-f94e20a08828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67133b6-da47-468f-808b-f94e20a08828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b075ab44-1ffc-4560-bfe5-c0b77437cc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:27 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Volume 23c91411-b869-436e-be43-c8dab76432f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c91411-b869-436e-be43-c8dab76432f2', 'volume_size': 1} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1543890661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c91411-b869-436e-be43-c8dab76432f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e1e8411741249578e9777daf55677f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:28Z,use_quota=True,user_id='4c696144296e4144932b399461c341aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Creating volume 23c91411-b869-436e-be43-c8dab76432f2 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:27 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:14:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:27 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 1073741824 Jul 21 19:14:27 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:28 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 1073741824" returned: 0 in 0.604s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:28 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 Jul 21 19:14:28 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:28 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2" returned: 0 in 0.297s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:28 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b075ab44-1ffc-4560-bfe5-c0b77437cc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c91411-b869-436e-be43-c8dab76432f2', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd894b0-a012-47ab-8d02-b088e3ef9c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:28 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Volume volume-23c91411-b869-436e-be43-c8dab76432f2 (23c91411-b869-436e-be43-c8dab76432f2): created successfully Jul 21 19:14:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd894b0-a012-47ab-8d02-b088e3ef9c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Flow 'volume_create_manager' (45687e46-3c48-437e-833f-f7ac98f2a8bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:28 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2d80208f-fd4d-4b52-b31e-d8b7906b0103 tempest-SnapshotDependencyTests-1057117957 None] Created volume successfully. Jul 21 19:14:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] Creating offline snapshot 70c53611-3132-4d1a-88df-0247ed09dad2 of volume 23c91411-b869-436e-be43-c8dab76432f2 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:14:30 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc697e0f-09a9-4c24-bc14-fc76d9182096]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:30 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 Jul 21 19:14:30 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:30 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2" returned: 0 in 0.425s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:30 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 1G Jul 21 19:14:30 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:31 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 1G" returned: 0 in 0.534s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23c91411-b869-436e-be43-c8dab76432f2 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:31 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23c91411-b869-436e-be43-c8dab76432f2 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 Jul 21 19:14:31 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:31 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23c91411-b869-436e-be43-c8dab76432f2 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2" returned: 0 in 0.358s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:31 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 is being set with open permissions: ugo+rw Jul 21 19:14:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:31 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 Jul 21 19:14:31 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:31 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2" returned: 0 in 0.269s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:31 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.info Jul 21 19:14:31 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:32 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.info" returned: 0 in 0.289s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:32 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.info is being set with open permissions: ugo+rw Jul 21 19:14:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:32 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.info Jul 21 19:14:32 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:32 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.info" returned: 0 in 0.292s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:32 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f5e9d9d7-6be9-41d8-904a-94154ea64269 tempest-SnapshotDependencyTests-1057117957 None] Create snapshot completed successfully Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Flow 'volume_create_manager' (d3ba1ce5-aaf1-4a2e-93ce-ffd31192fc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa866ba-7b26-4ba5-a56a-4c3af0f91967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa866ba-7b26-4ba5-a56a-4c3af0f91967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94f90e6-4b78-4e1f-a15d-deffd001ebd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e1e8411741249578e9777daf55677f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=70c53611-3132-4d1a-88df-0247ed09dad2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:34Z,use_quota=True,user_id='4c696144296e4144932b399461c341aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10dbb93f-8308-44cc-8de4-540869a5fc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10dbb93f-8308-44cc-8de4-540869a5fc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acba813-2d43-47ed-8872-68dd8102eb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acba813-2d43-47ed-8872-68dd8102eb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd94f90e6-4b78-4e1f-a15d-deffd001ebd8', 'volume_name': 'volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8', 'volume_size': 1, 'snapshot_id': '70c53611-3132-4d1a-88df-0247ed09dad2'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f433e0a0-62a2-453b-a47e-617e94a4ce98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f433e0a0-62a2-453b-a47e-617e94a4ce98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e23a50-4eee-462f-9223-0af17eb54f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:34 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Volume d94f90e6-4b78-4e1f-a15d-deffd001ebd8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8', 'volume_size': 1, 'snapshot_id': '70c53611-3132-4d1a-88df-0247ed09dad2'} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "cinder-quobyte-70c53611-3132-4d1a-88df-0247ed09dad2-d94f90e6-4b78-4e1f-a15d-deffd001ebd8" by "_create_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-quobyte-70c53611-3132-4d1a-88df-0247ed09dad2-d94f90e6-4b78-4e1f-a15d-deffd001ebd8" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Creating volume d94f90e6-4b78-4e1f-a15d-deffd001ebd8 from snapshot 70c53611-3132-4d1a-88df-0247ed09dad2 {{(pid=87487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "cinder-quobyte-d94f90e6-4b78-4e1f-a15d-deffd001ebd8" by "_copy_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-quobyte-d94f90e6-4b78-4e1f-a15d-deffd001ebd8" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] snapshot: 70c53611-3132-4d1a-88df-0247ed09dad2, volume: d94f90e6-4b78-4e1f-a15d-deffd001ebd8, {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21a90fd-3628-4e9b-b2a8-165b3a729706]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:34 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 Jul 21 19:14:34 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:34 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2" returned: 0 in 0.482s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23c91411-b869-436e-be43-c8dab76432f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Creating direct copy from snapshot {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf5cb4a-0b09-4286-9c23-707aa7c9f966]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:35 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 Jul 21 19:14:35 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:35 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2" returned: 0 in 0.458s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:35 devstack cinder-volume[87487]: DEBUG cinder.utils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Path /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8 not found in is_blk_device check {{(pid=87487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:14:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:35 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8 Jul 21 19:14:35 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:14:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:40 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:14:40 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:41 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8" returned: 0 in 5.771s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:41 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0eec8c-d73a-4e0c-9958-bc6fb0295257]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:41 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 Jul 21 19:14:41 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:41 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.613s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:41 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:41 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:14:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:14:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:14:41 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2" returned: 0 in 0.605s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:41 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:14:41 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Converted 1024.00 MB image at 177.40 MB/s Jul 21 19:14:41 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8 is being set with open permissions: ugo+rw Jul 21 19:14:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:41 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8 Jul 21 19:14:41 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:42 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8" returned: 0 in 0.258s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-quobyte-d94f90e6-4b78-4e1f-a15d-deffd001ebd8" released by "_copy_volume_from_snapshot" :: held 7.703s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-quobyte-70c53611-3132-4d1a-88df-0247ed09dad2-d94f90e6-4b78-4e1f-a15d-deffd001ebd8" released by "_create_volume_from_snapshot" :: held 7.740s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.763s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e23a50-4eee-462f-9223-0af17eb54f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8', 'volume_size': 1, 'snapshot_id': '70c53611-3132-4d1a-88df-0247ed09dad2'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d219ba1-9550-43bb-a769-39428dffaeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:42 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Volume volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8 (d94f90e6-4b78-4e1f-a15d-deffd001ebd8): created successfully Jul 21 19:14:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d219ba1-9550-43bb-a769-39428dffaeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Flow 'volume_create_manager' (d3ba1ce5-aaf1-4a2e-93ce-ffd31192fc5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:42 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-fd1b10a4-cd5e-4062-ab08-1ee0d9bbfcfc tempest-SnapshotDependencyTests-1057117957 None] Created volume successfully. Jul 21 19:14:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "cinder-70c53611-3132-4d1a-88df-0247ed09dad2-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-70c53611-3132-4d1a-88df-0247ed09dad2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "cinder-quobyte-23c91411-b869-436e-be43-c8dab76432f2" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-quobyte-23c91411-b869-436e-be43-c8dab76432f2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "cinder-quobyte-70c53611-3132-4d1a-88df-0247ed09dad2" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-quobyte-70c53611-3132-4d1a-88df-0247ed09dad2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Deleting offline snapshot 70c53611-3132-4d1a-88df-0247ed09dad2 of volume 23c91411-b869-436e-be43-c8dab76432f2 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:14:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] snapshot_file for this snap is: volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:14:43 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2107bf89-935f-48c9-853d-7efb34967533]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:43 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 Jul 21 19:14:43 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:43 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2" returned: 0 in 0.419s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23c91411-b869-436e-be43-c8dab76432f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:43 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0d3b18-5098-45d3-9260-a243b3ee86d1]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:43 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 Jul 21 19:14:43 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:44 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2" returned: 0 in 0.436s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:44 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 Jul 21 19:14:44 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:44 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2" returned: 0 in 0.458s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:44 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2 Jul 21 19:14:44 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:44 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2.70c53611-3132-4d1a-88df-0247ed09dad2" returned: 0 in 0.277s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-quobyte-70c53611-3132-4d1a-88df-0247ed09dad2" released by "_delete_snapshot" :: held 1.731s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-quobyte-23c91411-b869-436e-be43-c8dab76432f2" released by "delete_snapshot" :: held 1.767s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:45 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Created reservations ['a0368b50-540b-450d-8bc9-ab936ad87d26', 'dabcdb98-3b73-4c1e-9d9f-ff94de0c69d6', '876c0d63-daa3-42fe-b75d-5ac62e8e7ff8', 'b030176e-2ec3-4b02-abd1-24d48c52460c'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:45 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Delete snapshot completed successfully. Jul 21 19:14:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e7573b78-c497-40d2-9a5e-afbd1b5f14c3 tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-70c53611-3132-4d1a-88df-0247ed09dad2-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "cinder-23c91411-b869-436e-be43-c8dab76432f2-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-23c91411-b869-436e-be43-c8dab76432f2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "cinder-quobyte-23c91411-b869-436e-be43-c8dab76432f2" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-quobyte-23c91411-b869-436e-be43-c8dab76432f2" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:45 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fdf30d-5328-4cc9-9cee-0c5f4f00b6f9]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:45 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 Jul 21 19:14:45 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:46 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2" returned: 0 in 0.430s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:46 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2 Jul 21 19:14:46 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:46 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-23c91411-b869-436e-be43-c8dab76432f2" returned: 0 in 0.295s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-quobyte-23c91411-b869-436e-be43-c8dab76432f2" released by "delete_volume" :: held 0.807s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Created reservations ['c7c573d3-5fc8-48c9-ac74-4001c79152de', '59caf88c-c190-4a29-aca9-7271dcde11d5', 'a7b5c20c-630c-42ce-ac44-d4aad61b6d93', '8f6b639f-ff2e-4884-95d1-e6acedd5c860'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:46 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:14:46 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "cinder-d94f90e6-4b78-4e1f-a15d-deffd001ebd8-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-d94f90e6-4b78-4e1f-a15d-deffd001ebd8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "cinder-quobyte-d94f90e6-4b78-4e1f-a15d-deffd001ebd8" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-quobyte-d94f90e6-4b78-4e1f-a15d-deffd001ebd8" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[84702032-6536-4488-8a27-fc2590867530]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:46 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.327s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:46 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Deleted volume successfully. Jul 21 19:14:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-505d1f08-ffe9-4929-bdd1-c6c4755e81fe tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-23c91411-b869-436e-be43-c8dab76432f2-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:46 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8 Jul 21 19:14:46 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:47 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8" returned: 0 in 0.475s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:47 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8 Jul 21 19:14:47 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:47 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d94f90e6-4b78-4e1f-a15d-deffd001ebd8" returned: 0 in 0.309s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-quobyte-d94f90e6-4b78-4e1f-a15d-deffd001ebd8" released by "delete_volume" :: held 0.873s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:47 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Created reservations ['80aae7c4-da32-4bc0-ae75-55947410f8a7', '476e5492-737a-4734-ad27-cb36052c1e30', '145e1037-8f11-4805-b495-8c5f37c6f7eb', '15f6af24-fbec-4277-8228-1a12b08193c7'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:47 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:14:47 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:48 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.333s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:48 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:48 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Deleted volume successfully. Jul 21 19:14:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2d5affd9-d991-4a1e-a3c6-fa2b2a5a492d tempest-SnapshotDependencyTests-1057117957 None] Lock "cinder-d94f90e6-4b78-4e1f-a15d-deffd001ebd8-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Flow 'volume_create_manager' (50e19078-465f-4de4-a3a4-81392b01613b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a15e8e2-74e3-4f08-bf2c-7161e4e8d688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a15e8e2-74e3-4f08-bf2c-7161e4e8d688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-566875922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ace9c1b-abbb-44b8-8c8f-0b11b12717a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ca2b0f014447499417a489b88ec2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:57Z,use_quota=True,user_id='74db3c751a9e440abaae179d32a5e7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e14a972-f75a-44c4-8af6-310c6e02bc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e14a972-f75a-44c4-8af6-310c6e02bc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc9cb76-3fd2-4c48-b0a0-be5455bbb7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc9cb76-3fd2-4c48-b0a0-be5455bbb7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ace9c1b-abbb-44b8-8c8f-0b11b12717a4', 'volume_name': 'volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ceba681-2b2a-410a-b2d9-cb72d28cbc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ceba681-2b2a-410a-b2d9-cb72d28cbc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199b95d3-0ab9-462f-ba7c-70b5463d336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:57 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Volume 5ace9c1b-abbb-44b8-8c8f-0b11b12717a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4', 'volume_size': 1} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-566875922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ace9c1b-abbb-44b8-8c8f-0b11b12717a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ca2b0f014447499417a489b88ec2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:57Z,use_quota=True,user_id='74db3c751a9e440abaae179d32a5e7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Creating volume 5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:57 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:57 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 1073741824 Jul 21 19:14:57 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:57 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 1073741824" returned: 0 in 0.572s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:57 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 Jul 21 19:14:57 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:58 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" returned: 0 in 0.338s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199b95d3-0ab9-462f-ba7c-70b5463d336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d157ee-e60a-45bc-9946-375fbed6118c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:58 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Volume volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 (5ace9c1b-abbb-44b8-8c8f-0b11b12717a4): created successfully Jul 21 19:14:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d157ee-e60a-45bc-9946-375fbed6118c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:58 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Flow 'volume_create_manager' (50e19078-465f-4de4-a3a4-81392b01613b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:58 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ed543429-bab5-4968-874a-cf37542566eb tempest-VolumesActionsTest-361627131 None] Created volume successfully. Jul 21 19:15:08 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=38,cinder:INSERT=10,cinder:UPDATE=43,cinder:DELETE=4 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:15:08 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=33,cinder:INSERT=13,cinder:UPDATE=51,cinder:DELETE=4 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Flow 'volume_create_manager' (19ea204e-89b5-4ff7-a83f-05248164dce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bb96ad-ac92-4137-8972-2abdac07a125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bb96ad-ac92-4137-8972-2abdac07a125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-496298357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7775ccd-c398-4a91-9cd8-2a3b775d9080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35804851d5d0417489191de758537f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:10Z,use_quota=True,user_id='9999392c842a4c5cb4faaeb94bd1b9a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b210cb71-f463-4819-bcdc-6b4fea5da36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b210cb71-f463-4819-bcdc-6b4fea5da36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51dc5cb8-8fdd-4da7-82d9-69d1785dc3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51dc5cb8-8fdd-4da7-82d9-69d1785dc3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7775ccd-c398-4a91-9cd8-2a3b775d9080', 'volume_name': 'volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a887d24e-01a6-47a9-93c7-3b371952d230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a887d24e-01a6-47a9-93c7-3b371952d230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d5b180-3c09-46e0-a201-afaf0833fce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:10 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Volume d7775ccd-c398-4a91-9cd8-2a3b775d9080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080', 'volume_size': 1} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-496298357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7775ccd-c398-4a91-9cd8-2a3b775d9080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35804851d5d0417489191de758537f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:10Z,use_quota=True,user_id='9999392c842a4c5cb4faaeb94bd1b9a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Creating volume d7775ccd-c398-4a91-9cd8-2a3b775d9080 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:10 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:15:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:10 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 1073741824 Jul 21 19:15:10 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:11 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 1073741824" returned: 0 in 0.797s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:11 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 Jul 21 19:15:11 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:11 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080" returned: 0 in 0.423s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d5b180-3c09-46e0-a201-afaf0833fce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea1177f-e0fd-4d6f-91de-e8dc5377ce00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:12 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Volume volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 (d7775ccd-c398-4a91-9cd8-2a3b775d9080): created successfully Jul 21 19:15:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea1177f-e0fd-4d6f-91de-e8dc5377ce00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Flow 'volume_create_manager' (19ea204e-89b5-4ff7-a83f-05248164dce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:12 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-87656818-54f4-40e9-81eb-50119b0db0b7 tempest-TestStampPattern-1917288352 None] Created volume successfully. Jul 21 19:15:12 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-018fcc4d-14f9-43c4-898f-96541d8660a9 tempest-VolumesActionsTest-361627131 None] Acquiring lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" by "attach_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:12 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-018fcc4d-14f9-43c4-898f-96541d8660a9 tempest-VolumesActionsTest-361627131 None] Lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" acquired by "attach_volume" :: waited 0.031s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:12 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-018fcc4d-14f9-43c4-898f-96541d8660a9 tempest-VolumesActionsTest-361627131 None] Attaching volume 5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 to instance 1fceddb6-c55b-4f18-95fb-a0a2295c49f4 at mountpoint /dev/vdb on host None. Jul 21 19:15:12 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-018fcc4d-14f9-43c4-898f-96541d8660a9 tempest-VolumesActionsTest-361627131 None] Attach volume completed successfully. Jul 21 19:15:12 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-018fcc4d-14f9-43c4-898f-96541d8660a9 tempest-VolumesActionsTest-361627131 None] Lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" released by "attach_volume" :: held 0.111s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:12 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5476f828-c474-40f7-bbe7-d92b8a34f459 tempest-VolumesActionsTest-361627131 None] Acquiring lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4-detach_volume" by "detach_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:12 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5476f828-c474-40f7-bbe7-d92b8a34f459 tempest-VolumesActionsTest-361627131 None] Lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:12 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5476f828-c474-40f7-bbe7-d92b8a34f459 tempest-VolumesActionsTest-361627131 None] Detaching volume 5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 from instance 1fceddb6-c55b-4f18-95fb-a0a2295c49f4. Jul 21 19:15:12 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5476f828-c474-40f7-bbe7-d92b8a34f459 tempest-VolumesActionsTest-361627131 None] Detach volume completed successfully. Jul 21 19:15:12 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5476f828-c474-40f7-bbe7-d92b8a34f459 tempest-VolumesActionsTest-361627131 None] Lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:22 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:15:22 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:15:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-12eeacc6-6a5d-4239-b69e-c39a065a31e4 tempest-VolumesActionsTest-361627131 None] Acquiring lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" by "attach_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-12eeacc6-6a5d-4239-b69e-c39a065a31e4 tempest-VolumesActionsTest-361627131 None] Lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" acquired by "attach_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-12eeacc6-6a5d-4239-b69e-c39a065a31e4 tempest-VolumesActionsTest-361627131 None] Attaching volume 5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 to instance 3e5dd3e5-4f0a-4dab-906c-1a0a5defb976 at mountpoint /dev/vdb on host None. Jul 21 19:15:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-12eeacc6-6a5d-4239-b69e-c39a065a31e4 tempest-VolumesActionsTest-361627131 None] Attach volume completed successfully. Jul 21 19:15:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-12eeacc6-6a5d-4239-b69e-c39a065a31e4 tempest-VolumesActionsTest-361627131 None] Lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" released by "attach_volume" :: held 0.087s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ce3e8a10-8468-4df4-8297-51df9e327474 tempest-VolumesActionsTest-361627131 None] Acquiring lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4-detach_volume" by "detach_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ce3e8a10-8468-4df4-8297-51df9e327474 tempest-VolumesActionsTest-361627131 None] Lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ce3e8a10-8468-4df4-8297-51df9e327474 tempest-VolumesActionsTest-361627131 None] Detaching volume 5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 from instance 3e5dd3e5-4f0a-4dab-906c-1a0a5defb976. Jul 21 19:15:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ce3e8a10-8468-4df4-8297-51df9e327474 tempest-VolumesActionsTest-361627131 None] Detach volume completed successfully. Jul 21 19:15:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ce3e8a10-8468-4df4-8297-51df9e327474 tempest-VolumesActionsTest-361627131 None] Lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:30 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02bd61e-8e2a-4a02-8a5d-b5bdb2390a36]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:30 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 Jul 21 19:15:30 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:30 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" returned: 0 in 0.365s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:30 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17763c2-1544-40e3-9054-09cd2cf835de]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:30 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 Jul 21 19:15:30 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:30 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" returned: 0 in 0.354s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.a4516126-7c80-402d-b3d8-34b25779d1ea1xm9_wlt.img {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:30 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.a4516126-7c80-402d-b3d8-34b25779d1ea1xm9_wlt.img Jul 21 19:15:30 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:34 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.a4516126-7c80-402d-b3d8-34b25779d1ea1xm9_wlt.img" returned: 0 in 3.981s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:34 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[80817285-800b-4256-b2dd-5c2021c9bae3]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:35 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 Jul 21 19:15:35 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:35 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" returned: 0 in 0.515s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:35 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4, size 1024.00 MB, duration 3.98 sec, destination /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.a4516126-7c80-402d-b3d8-34b25779d1ea1xm9_wlt.img {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:15:35 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] Converted 1024.00 MB image at 257.16 MB/s Jul 21 19:15:35 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] a4516126-7c80-402d-b3d8-34b25779d1ea was raw, no need to convert to raw {{(pid=87487) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 21 19:15:40 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:15:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:15:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:40 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:15:40 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:40 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.242s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:40 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:15:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:15:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:15:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-769d41a3-05f2-4961-9a2d-2f5119f97dc7 req-5e1400d7-f94c-4906-ade1-66580a518b4a tempest-TestStampPattern-1917288352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:45 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=4 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:15:54 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=2 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:15:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.951s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] Uploaded volume to glance image-id: a4516126-7c80-402d-b3d8-34b25779d1ea. {{(pid=87487) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 21 19:15:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-769d41a3-05f2-4961-9a2d-2f5119f97dc7 req-5e1400d7-f94c-4906-ade1-66580a518b4a tempest-TestStampPattern-1917288352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.836s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-769d41a3-05f2-4961-9a2d-2f5119f97dc7 req-5e1400d7-f94c-4906-ade1-66580a518b4a tempest-TestStampPattern-1917288352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:55 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-222be580-c98c-4cf1-b38e-223671a200b2 tempest-VolumesActionsTest-361627131 None] Copy volume to image completed successfully. Jul 21 19:15:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-769d41a3-05f2-4961-9a2d-2f5119f97dc7 req-5e1400d7-f94c-4906-ade1-66580a518b4a tempest-TestStampPattern-1917288352 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ce75016-cf07-4012-a2c3-1bd77cd730df', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:15:55 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-769d41a3-05f2-4961-9a2d-2f5119f97dc7 req-5e1400d7-f94c-4906-ade1-66580a518b4a tempest-TestStampPattern-1917288352 None] attachment_update completed successfully. Jul 21 19:15:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:57 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3949e639-39b0-45ad-ad08-08e3c023b8e8]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:57 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 Jul 21 19:15:57 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:57 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" returned: 0 in 0.373s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:57 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c642190-91b6-4ac4-a816-6dd369c0f832]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:57 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 Jul 21 19:15:57 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:57 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" returned: 0 in 0.385s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:57 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img Jul 21 19:15:57 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:01 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-3fd90279-02e1-4675-afdf-4a32572b579d req-703c6407-2d04-4e26-a565-c690965d2d7b tempest-TestStampPattern-1917288352 None] Terminate volume connection completed successfully. Jul 21 19:16:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-3fd90279-02e1-4675-afdf-4a32572b579d req-703c6407-2d04-4e26-a565-c690965d2d7b tempest-TestStampPattern-1917288352 None] Deleting attachment 0ce75016-cf07-4012-a2c3-1bd77cd730df. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:16:02 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img" returned: 0 in 4.339s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:02 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5c0ccf-a964-4cf4-99ce-5522c9f55989]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:02 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 Jul 21 19:16:02 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:02 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" returned: 0 in 0.533s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:02 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:16:02 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Converted 1024.00 MB image at 235.95 MB/s Jul 21 19:16:02 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] c3eec323-b82d-47f4-9818-1eab1ef1c437 was raw, converting to qcow2 {{(pid=87487) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 21 19:16:02 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[392d9641-1b5e-4d1d-9728-733c894bef18]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:02 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img Jul 21 19:16:02 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:03 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img" returned: 0 in 0.333s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:03 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img Jul 21 19:16:03 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:03 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img" returned: 1 in 0.337s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:16:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img /opt/stack/data/cinder/conversion/vol_upload_70wcp_bj {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:03 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img /opt/stack/data/cinder/conversion/vol_upload_70wcp_bj Jul 21 19:16:03 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:03 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img /opt/stack/data/cinder/conversion/vol_upload_70wcp_bj" returned: 0 in 0.267s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:03 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Image conversion details: src /opt/stack/data/cinder/conversion/5ace9c1b-abbb-44b8-8c8f-0b11b12717a4.temp_image.c3eec323-b82d-47f4-9818-1eab1ef1c437ee3y1jfw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_70wcp_bj {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:16:03 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 21 19:16:03 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ebdc05-8a21-4219-87e8-9013b93b58f5]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_70wcp_bj {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:03 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_70wcp_bj Jul 21 19:16:03 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:04 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_70wcp_bj" returned: 0 in 0.334s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.375s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Uploaded volume to glance image-id: c3eec323-b82d-47f4-9818-1eab1ef1c437. {{(pid=87487) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 21 19:16:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.969s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] Creating offline snapshot 1c77af0b-863d-41f3-97d2-146fae0c090d of volume d7775ccd-c398-4a91-9cd8-2a3b775d9080 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:16:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-736e46f4-e8ca-4de2-b3f4-93be6fb485e4 tempest-VolumesActionsTest-361627131 None] Copy volume to image completed successfully. Jul 21 19:16:05 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[233cf206-5c79-4fca-be82-183770fc83e7]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:05 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 Jul 21 19:16:05 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:05 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080" returned: 0 in 0.361s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:05 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d 1G Jul 21 19:16:05 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:06 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d 1G" returned: 0 in 0.405s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:06 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d Jul 21 19:16:06 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:06 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d" returned: 0 in 0.298s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:06 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d is being set with open permissions: ugo+rw Jul 21 19:16:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:06 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d Jul 21 19:16:06 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:06 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d" returned: 0 in 0.266s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:06 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.info Jul 21 19:16:06 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:07 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.info" returned: 0 in 0.281s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:07 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.info is being set with open permissions: ugo+rw Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:07 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.info Jul 21 19:16:07 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Acquiring lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Acquiring lock "cinder-quobyte-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Lock "cinder-quobyte-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb5fd35-1746-4b95-8c5a-5cb7dc14c1d3]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:07 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.info" returned: 0 in 0.255s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:07 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 Jul 21 19:16:07 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:07 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3d75b148-1b52-4dec-bfa3-094a282fd5cb tempest-TestStampPattern-1917288352 None] Create snapshot completed successfully Jul 21 19:16:07 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" returned: 0 in 0.364s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:07 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4 Jul 21 19:16:07 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:07 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" returned: 0 in 0.253s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Lock "cinder-quobyte-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4" released by "delete_volume" :: held 0.656s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:07 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Created reservations ['4a40f4a9-08b2-45d9-89de-c92af42e6e1d', '997310cc-1ec9-4a63-866b-3173dc37972a', 'f238d404-22fe-4e5a-ac4f-af2bc2b34cc6', '222357c9-8f1a-49b4-93ee-ae8e9f7c5a80'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:08 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:08 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:08 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:16:08 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:08 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.259s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:08 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:08 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Deleted volume successfully. Jul 21 19:16:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adb94d54-2cf5-4202-afbe-c4f6d3f86531 tempest-VolumesActionsTest-361627131 None] Lock "cinder-5ace9c1b-abbb-44b8-8c8f-0b11b12717a4-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Flow 'volume_create_manager' (ea9e9034-40ed-4fad-949f-38921406a670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7faa82-fd26-4f8b-9e4c-a1bb2675da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7faa82-fd26-4f8b-9e4c-a1bb2675da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-141188079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8125b5be-7b92-4343-8f35-ede96de79a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35804851d5d0417489191de758537f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c77af0b-863d-41f3-97d2-146fae0c090d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:14Z,use_quota=True,user_id='9999392c842a4c5cb4faaeb94bd1b9a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d87d50-4734-4815-890e-1b06c91b217c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d87d50-4734-4815-890e-1b06c91b217c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a44994f-ae6b-4dcc-8161-12f48f57e017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a44994f-ae6b-4dcc-8161-12f48f57e017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8125b5be-7b92-4343-8f35-ede96de79a48', 'volume_name': 'volume-8125b5be-7b92-4343-8f35-ede96de79a48', 'volume_size': 1, 'snapshot_id': '1c77af0b-863d-41f3-97d2-146fae0c090d'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76cac6a8-35eb-4a3f-9e08-c15d53391f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76cac6a8-35eb-4a3f-9e08-c15d53391f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98fb608-ff59-472f-b2d6-cd3ae97aa3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:14 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Volume 8125b5be-7b92-4343-8f35-ede96de79a48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8125b5be-7b92-4343-8f35-ede96de79a48', 'volume_size': 1, 'snapshot_id': '1c77af0b-863d-41f3-97d2-146fae0c090d'} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Acquiring lock "cinder-quobyte-1c77af0b-863d-41f3-97d2-146fae0c090d-8125b5be-7b92-4343-8f35-ede96de79a48" by "_create_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Lock "cinder-quobyte-1c77af0b-863d-41f3-97d2-146fae0c090d-8125b5be-7b92-4343-8f35-ede96de79a48" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Creating volume 8125b5be-7b92-4343-8f35-ede96de79a48 from snapshot 1c77af0b-863d-41f3-97d2-146fae0c090d {{(pid=87487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Acquiring lock "cinder-quobyte-8125b5be-7b92-4343-8f35-ede96de79a48" by "_copy_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Lock "cinder-quobyte-8125b5be-7b92-4343-8f35-ede96de79a48" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] snapshot: 1c77af0b-863d-41f3-97d2-146fae0c090d, volume: 8125b5be-7b92-4343-8f35-ede96de79a48, {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c431bd3-c07e-4180-b5ae-d1d1a21c2e18]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:14 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d Jul 21 19:16:14 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:15 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d" returned: 0 in 0.413s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Creating direct copy from snapshot {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[727717df-331c-4eaa-9c2f-34a5683de78f]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:15 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 Jul 21 19:16:15 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:15 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080" returned: 0 in 0.426s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.utils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Path /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48 not found in is_blk_device check {{(pid=87487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:15 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48 Jul 21 19:16:15 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Flow 'volume_create_manager' (f338542a-ee02-4ea6-a85b-37890cbfb8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07de2d8-fa89-4670-97ad-3d7a11761f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07de2d8-fa89-4670-97ad-3d7a11761f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1404281079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e3cdb7-4cde-4273-bc1b-8319774d3fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a3d0b0bfc74ccca89477edda8d30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:16Z,use_quota=True,user_id='3480e6a9ff9e458db1372473058fc0e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc37f58-9f09-49cb-a278-399aa1da2c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc37f58-9f09-49cb-a278-399aa1da2c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b03622f-1811-410b-b721-717c204a8a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b03622f-1811-410b-b721-717c204a8a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e3cdb7-4cde-4273-bc1b-8319774d3fbb', 'volume_name': 'volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb', 'volume_size': 2}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08505842-722e-466e-952b-143d47332fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08505842-722e-466e-952b-143d47332fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fb3ef9-4961-43bc-8c2c-7760dfd38604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:15 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Volume 87e3cdb7-4cde-4273-bc1b-8319774d3fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb', 'volume_size': 2} Jul 21 19:16:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:21 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48" returned: 0 in 5.606s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:21 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2440dfb-aae3-4aad-96d4-6750640da8ff]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:21 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 Jul 21 19:16:21 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:21 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080" returned: 0 in 0.605s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:21 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:16:21 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Converted 1024.00 MB image at 182.58 MB/s Jul 21 19:16:21 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48 is being set with open permissions: ugo+rw Jul 21 19:16:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:21 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48 Jul 21 19:16:21 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:22 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48" returned: 0 in 0.312s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Lock "cinder-quobyte-8125b5be-7b92-4343-8f35-ede96de79a48" released by "_copy_volume_from_snapshot" :: held 7.492s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Lock "cinder-quobyte-1c77af0b-863d-41f3-97d2-146fae0c090d-8125b5be-7b92-4343-8f35-ede96de79a48" released by "_create_volume_from_snapshot" :: held 7.528s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.554s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.256s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1404281079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e3cdb7-4cde-4273-bc1b-8319774d3fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a3d0b0bfc74ccca89477edda8d30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:16Z,use_quota=True,user_id='3480e6a9ff9e458db1372473058fc0e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Creating volume 87e3cdb7-4cde-4273-bc1b-8319774d3fbb {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:22 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb 2147483648 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:22 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb 2147483648 Jul 21 19:16:22 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98fb608-ff59-472f-b2d6-cd3ae97aa3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8125b5be-7b92-4343-8f35-ede96de79a48', 'volume_size': 1, 'snapshot_id': '1c77af0b-863d-41f3-97d2-146fae0c090d'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d555dc2e-22c1-4ba8-9e2b-989f446f616e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:22 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Volume volume-8125b5be-7b92-4343-8f35-ede96de79a48 (8125b5be-7b92-4343-8f35-ede96de79a48): created successfully Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d555dc2e-22c1-4ba8-9e2b-989f446f616e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Flow 'volume_create_manager' (ea9e9034-40ed-4fad-949f-38921406a670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:22 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a7c70e94-2101-4727-8cd6-e689f310fe7c tempest-TestStampPattern-1917288352 None] Created volume successfully. Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb 2147483648" returned: 0 in 0.626s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:22 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:22 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb Jul 21 19:16:22 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:23 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb" returned: 0 in 0.353s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fb3ef9-4961-43bc-8c2c-7760dfd38604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb', 'volume_size': 2}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedbfd0b-e0a8-4ee0-a5b1-a26e64aec7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:23 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Volume volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb (87e3cdb7-4cde-4273-bc1b-8319774d3fbb): created successfully Jul 21 19:16:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedbfd0b-e0a8-4ee0-a5b1-a26e64aec7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Flow 'volume_create_manager' (f338542a-ee02-4ea6-a85b-37890cbfb8fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:23 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-1edb019c-36bf-460d-ad1b-1779bd308b87 tempest-VolumesCloneNegativeTest-416995789 None] Created volume successfully. Jul 21 19:16:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Acquiring lock "cinder-87e3cdb7-4cde-4273-bc1b-8319774d3fbb-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Lock "cinder-87e3cdb7-4cde-4273-bc1b-8319774d3fbb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Acquiring lock "cinder-quobyte-87e3cdb7-4cde-4273-bc1b-8319774d3fbb" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Lock "cinder-quobyte-87e3cdb7-4cde-4273-bc1b-8319774d3fbb" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:23 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f70b5a-ff07-41cc-bd27-4e6b675679b7]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:24 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb Jul 21 19:16:24 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:24 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb" returned: 0 in 0.427s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:24 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb Jul 21 19:16:24 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:24 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-87e3cdb7-4cde-4273-bc1b-8319774d3fbb" returned: 0 in 0.278s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Lock "cinder-quobyte-87e3cdb7-4cde-4273-bc1b-8319774d3fbb" released by "delete_volume" :: held 0.746s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:24 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Created reservations ['cffda5e5-41ba-49dd-b51d-8b31501e632e', 'b19b3871-9344-4084-a6a7-b0169bd3d48e', '2f36cb33-4e8e-4bcf-990d-16b881bacb04', '6d9e67d2-f190-4769-8971-29a81378ed68'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:24 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:16:24 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:25 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.266s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:25 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Deleted volume successfully. Jul 21 19:16:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-48791cd0-2bc0-4c57-a539-e0ccd8e3c50b tempest-VolumesCloneNegativeTest-416995789 None] Lock "cinder-87e3cdb7-4cde-4273-bc1b-8319774d3fbb-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:28 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Flow 'volume_create_manager' (f13a38a2-bf7d-4fa2-b46d-bf17495eef63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a11d129-83f9-4a89-8df2-29b5933ead0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a11d129-83f9-4a89-8df2-29b5933ead0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-6124645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2acfab-2524-4cd2-9fc1-95b9106e17e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aca5ef623df456a854213091c0c7c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:29Z,use_quota=True,user_id='dbc8682ade744a3cbab0a4c180170be9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cb9218-138a-4804-a400-4b277d2cfb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cb9218-138a-4804-a400-4b277d2cfb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708cb221-c91f-4420-8b3a-2c329e6b6fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:28 devstack cinder-volume[87487]: DEBUG cinder.image.glance [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Creating Keystone auth plugin from conf {{(pid=87487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:16:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708cb221-c91f-4420-8b3a-2c329e6b6fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b2acfab-2524-4cd2-9fc1-95b9106e17e7', 'volume_name': 'volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7', 'volume_size': 1, 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3621f130346745d7901341d043a6da99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'created_at': datetime.datetime(2026, 7, 21, 16, 56, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc66b18b-6093-4756-9dba-09c30714a99f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22e2e72-fadd-4298-a80b-99aee353ed5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22e2e72-fadd-4298-a80b-99aee353ed5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49537467-cfe8-422d-bc92-f46bc8b0b231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:28 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Volume 8b2acfab-2524-4cd2-9fc1-95b9106e17e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7', 'volume_size': 1, 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3621f130346745d7901341d043a6da99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'created_at': datetime.datetime(2026, 7, 21, 16, 56, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc66b18b-6093-4756-9dba-09c30714a99f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 19:16:28 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Trying to clone 8b2acfab-2524-4cd2-9fc1-95b9106e17e7 from image cc66b18b-6093-4756-9dba-09c30714a99f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]). {{(pid=87487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:16:29 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_269efsscdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:16:29 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Image download 20.69 MB at 20.69 MB/s Jul 21 19:16:29 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2996810-409a-42b5-af5f-f0e0b1dcc0c7]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_269efsscdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:29 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_269efsscdevstack@QuobyteHD Jul 21 19:16:29 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:29 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_269efsscdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:29 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Temporary image cc66b18b-6093-4756-9dba-09c30714a99f is fetched for user dbc8682ade744a3cbab0a4c180170be9. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:16:29 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b820b763-1b97-4140-9ce7-214f9bea5907]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_269efsscdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:29 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_269efsscdevstack@QuobyteHD Jul 21 19:16:29 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:29 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_269efsscdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-6124645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2acfab-2524-4cd2-9fc1-95b9106e17e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aca5ef623df456a854213091c0c7c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:29Z,use_quota=True,user_id='dbc8682ade744a3cbab0a4c180170be9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Creating volume 8b2acfab-2524-4cd2-9fc1-95b9106e17e7 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:30 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:30 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 1073741824 Jul 21 19:16:30 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:30 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 1073741824" returned: 0 in 0.403s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:30 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 Jul 21 19:16:30 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:30 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7" returned: 0 in 0.254s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Attempting download of cc66b18b-6093-4756-9dba-09c30714a99f ((None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}])) to volume 8b2acfab-2524-4cd2-9fc1-95b9106e17e7. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3ab4b9-9d4b-465a-b51e-7eacb7b9384e]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_oiuukn0r {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:30 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_oiuukn0r Jul 21 19:16:30 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:31 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_oiuukn0r" returned: 0 in 0.318s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_oiuukn0r {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:31 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_oiuukn0r Jul 21 19:16:31 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:31 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_oiuukn0r" returned: 1 in 0.314s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_oiuukn0r' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:16:31 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b29d068-ba55-420d-b02e-30d74edae580]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_269efsscdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:31 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_269efsscdevstack@QuobyteHD Jul 21 19:16:31 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:31 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_269efsscdevstack@QuobyteHD" returned: 0 in 0.306s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:31 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] cc66b18b-6093-4756-9dba-09c30714a99f was qcow2, converting to qcow2 {{(pid=87487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:16:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_269efsscdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:31 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_269efsscdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 Jul 21 19:16:31 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:33 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_269efsscdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7" returned: 0 in 1.671s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:33 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_269efsscdevstack@QuobyteHD, size 112.00 MB, duration 1.67 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:16:33 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Converted 112.00 MB image at 66.97 MB/s Jul 21 19:16:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:33 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 1G Jul 21 19:16:33 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:33 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 1G" returned: 0 in 0.312s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:33 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Downloaded image cc66b18b-6093-4756-9dba-09c30714a99f ((None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}])) to volume 8b2acfab-2524-4cd2-9fc1-95b9106e17e7 successfully. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:16:33 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Temporary image cc66b18b-6093-4756-9dba-09c30714a99f for user dbc8682ade744a3cbab0a4c180170be9 is deleted. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:16:33 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Marking volume 8b2acfab-2524-4cd2-9fc1-95b9106e17e7 as bootable. {{(pid=87487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:16:33 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Copying metadata from image cc66b18b-6093-4756-9dba-09c30714a99f to 8b2acfab-2524-4cd2-9fc1-95b9106e17e7. {{(pid=87487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:16:33 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Creating volume glance metadata for volume 8b2acfab-2524-4cd2-9fc1-95b9106e17e7 backed by image cc66b18b-6093-4756-9dba-09c30714a99f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:16:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49537467-cfe8-422d-bc92-f46bc8b0b231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7', 'volume_size': 1, 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3621f130346745d7901341d043a6da99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'created_at': datetime.datetime(2026, 7, 21, 16, 56, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc66b18b-6093-4756-9dba-09c30714a99f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de85afb-856e-427a-bacd-87569748e7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:33 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Volume volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 (8b2acfab-2524-4cd2-9fc1-95b9106e17e7): created successfully Jul 21 19:16:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de85afb-856e-427a-bacd-87569748e7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Flow 'volume_create_manager' (f13a38a2-bf7d-4fa2-b46d-bf17495eef63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:33 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9d978d1f-761d-4112-b19b-68587dab2f1e tempest-VolumesExtendTest-1292632069 None] Created volume successfully. Jul 21 19:16:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-302481b6-f9d3-40c7-8e13-55ea0bdaf8fc tempest-VolumesExtendTest-1292632069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-302481b6-f9d3-40c7-8e13-55ea0bdaf8fc tempest-VolumesExtendTest-1292632069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:35 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca242230-15d8-465a-b5f9-9060c7ff52e7]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-302481b6-f9d3-40c7-8e13-55ea0bdaf8fc tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:35 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 Jul 21 19:16:35 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:35 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-302481b6-f9d3-40c7-8e13-55ea0bdaf8fc tempest-VolumesExtendTest-1292632069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7" returned: 0 in 0.351s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-302481b6-f9d3-40c7-8e13-55ea0bdaf8fc tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 2G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-302481b6-f9d3-40c7-8e13-55ea0bdaf8fc tempest-VolumesExtendTest-1292632069 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 2G" returned: 0 in 0.092s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-302481b6-f9d3-40c7-8e13-55ea0bdaf8fc tempest-VolumesExtendTest-1292632069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.471s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:35 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-302481b6-f9d3-40c7-8e13-55ea0bdaf8fc tempest-VolumesExtendTest-1292632069 None] Extend volume completed successfully. Jul 21 19:16:36 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Acquiring lock "cinder-8b2acfab-2524-4cd2-9fc1-95b9106e17e7-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:36 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Lock "cinder-8b2acfab-2524-4cd2-9fc1-95b9106e17e7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:36 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Acquiring lock "cinder-quobyte-8b2acfab-2524-4cd2-9fc1-95b9106e17e7" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:36 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Lock "cinder-quobyte-8b2acfab-2524-4cd2-9fc1-95b9106e17e7" acquired by "delete_volume" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:36 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1cbf75-20df-49ea-b7a8-0edfba1db276]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:36 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 Jul 21 19:16:36 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:36 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7" returned: 0 in 0.368s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:36 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7 Jul 21 19:16:36 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:37 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8b2acfab-2524-4cd2-9fc1-95b9106e17e7" returned: 0 in 0.236s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Lock "cinder-quobyte-8b2acfab-2524-4cd2-9fc1-95b9106e17e7" released by "delete_volume" :: held 0.646s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Created reservations ['72a4fa5b-ccc6-4f63-86cc-dea4b069017f', '375b7c6c-b06f-4b56-9831-d126edde77c8', '0c3bd38b-664e-4ac8-97d1-521022453e0c', '9a55656c-4216-43a4-a27a-5a14121b10b8'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:37 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:16:37 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:37 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.248s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:37 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Deleted volume successfully. Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2099cc6b-0c60-43fe-afef-d3dae20367ee tempest-VolumesExtendTest-1292632069 None] Lock "cinder-8b2acfab-2524-4cd2-9fc1-95b9106e17e7-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Flow 'volume_create_manager' (225f76e0-b37e-4bcf-8f6d-0f1445efdd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ac459b-5107-4b65-81a9-eac1a9eb4239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ac459b-5107-4b65-81a9-eac1a9eb4239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-510949155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7193e5db-a9ca-4015-a5ad-fafe9cb64743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aca5ef623df456a854213091c0c7c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:38Z,use_quota=True,user_id='dbc8682ade744a3cbab0a4c180170be9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7786ca8-1ef5-44d9-8b38-54e32c5749a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7786ca8-1ef5-44d9-8b38-54e32c5749a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921d334b-e0e8-4dec-9b60-6baeb2e7e73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921d334b-e0e8-4dec-9b60-6baeb2e7e73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7193e5db-a9ca-4015-a5ad-fafe9cb64743', 'volume_name': 'volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b775c800-608c-4f51-b8b7-f38d33f12c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b775c800-608c-4f51-b8b7-f38d33f12c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a825c87-946c-41ac-b390-8f404489b801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:38 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Volume 7193e5db-a9ca-4015-a5ad-fafe9cb64743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743', 'volume_size': 1} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-510949155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7193e5db-a9ca-4015-a5ad-fafe9cb64743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aca5ef623df456a854213091c0c7c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:38Z,use_quota=True,user_id='dbc8682ade744a3cbab0a4c180170be9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Creating volume 7193e5db-a9ca-4015-a5ad-fafe9cb64743 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:38 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:38 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 1073741824 Jul 21 19:16:38 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:38 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 1073741824" returned: 0 in 0.410s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:38 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 Jul 21 19:16:38 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:38 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743" returned: 0 in 0.256s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a825c87-946c-41ac-b390-8f404489b801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0159b263-0984-42ff-aea9-805b93e79b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:38 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Volume volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 (7193e5db-a9ca-4015-a5ad-fafe9cb64743): created successfully Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0159b263-0984-42ff-aea9-805b93e79b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Flow 'volume_create_manager' (225f76e0-b37e-4bcf-8f6d-0f1445efdd6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:38 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9f1c886b-a5a2-496a-8f92-35a726f29f9b tempest-VolumesExtendTest-1292632069 None] Created volume successfully. Jul 21 19:16:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] Creating offline snapshot 11ee8717-df16-4639-bc40-311ee346f552 of volume 7193e5db-a9ca-4015-a5ad-fafe9cb64743 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:16:39 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[64908154-5e10-4fb9-92af-ec669f59797e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:39 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 Jul 21 19:16:39 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:39 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743" returned: 0 in 0.353s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:39 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 1G Jul 21 19:16:39 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:39 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 1G" returned: 0 in 0.392s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:39 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 Jul 21 19:16:39 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:40 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552" returned: 0 in 0.305s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:40 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 is being set with open permissions: ugo+rw Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:40 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 Jul 21 19:16:40 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:40 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552" returned: 0 in 0.259s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:40 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.info Jul 21 19:16:40 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:40 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:16:40 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:40 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.info" returned: 0 in 0.253s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:40 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.info is being set with open permissions: ugo+rw Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:40 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.info Jul 21 19:16:40 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:40 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.277s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:16:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:16:41 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.info" returned: 0 in 0.247s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:41 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-1f19c48d-5d42-49d8-9fa8-a9ae8d0b41c6 tempest-VolumesExtendTest-1292632069 None] Create snapshot completed successfully Jul 21 19:16:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-05ace670-dbe6-4b5a-989c-c5b3982d56e1 tempest-VolumesExtendTest-1292632069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-05ace670-dbe6-4b5a-989c-c5b3982d56e1 tempest-VolumesExtendTest-1292632069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:41 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f97408-73b4-4285-a0b3-430c07766cf3]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-05ace670-dbe6-4b5a-989c-c5b3982d56e1 tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:41 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 Jul 21 19:16:41 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:41 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-05ace670-dbe6-4b5a-989c-c5b3982d56e1 tempest-VolumesExtendTest-1292632069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743" returned: 0 in 0.369s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-05ace670-dbe6-4b5a-989c-c5b3982d56e1 tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 2G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-05ace670-dbe6-4b5a-989c-c5b3982d56e1 tempest-VolumesExtendTest-1292632069 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 2G" returned: 0 in 0.121s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-05ace670-dbe6-4b5a-989c-c5b3982d56e1 tempest-VolumesExtendTest-1292632069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.523s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:41 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-05ace670-dbe6-4b5a-989c-c5b3982d56e1 tempest-VolumesExtendTest-1292632069 None] Extend volume completed successfully. Jul 21 19:16:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Acquiring lock "cinder-11ee8717-df16-4639-bc40-311ee346f552-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Lock "cinder-11ee8717-df16-4639-bc40-311ee346f552-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Acquiring lock "cinder-quobyte-7193e5db-a9ca-4015-a5ad-fafe9cb64743" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Lock "cinder-quobyte-7193e5db-a9ca-4015-a5ad-fafe9cb64743" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Acquiring lock "cinder-quobyte-11ee8717-df16-4639-bc40-311ee346f552" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Lock "cinder-quobyte-11ee8717-df16-4639-bc40-311ee346f552" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:42 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Deleting offline snapshot 11ee8717-df16-4639-bc40-311ee346f552 of volume 7193e5db-a9ca-4015-a5ad-fafe9cb64743 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:16:42 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] snapshot_file for this snap is: volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:16:42 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7eeb6a6-5d44-466f-a27b-0f41e0a79c6f]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:42 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 Jul 21 19:16:42 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:43 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552" returned: 0 in 0.375s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:16:43 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92bc7a0-c1c6-4c42-8fd7-dc8ddf984f77]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:43 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 Jul 21 19:16:43 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:43 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743" returned: 0 in 0.362s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:43 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 Jul 21 19:16:43 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:43 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552" returned: 0 in 0.383s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:43 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552 Jul 21 19:16:43 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:44 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743.11ee8717-df16-4639-bc40-311ee346f552" returned: 0 in 0.257s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Lock "cinder-quobyte-11ee8717-df16-4639-bc40-311ee346f552" released by "_delete_snapshot" :: held 1.484s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Lock "cinder-quobyte-7193e5db-a9ca-4015-a5ad-fafe9cb64743" released by "delete_snapshot" :: held 1.513s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:44 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Created reservations ['5b2f09b9-c1ad-4237-83b3-a53507681b5b', '38422695-663b-4272-81d2-de8e7b209ca7', '145384e2-26e8-4fdf-aef2-4f87493f4d0f', '5faa73cc-05d0-4dc3-8785-5c9fc55ab243'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:44 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Delete snapshot completed successfully. Jul 21 19:16:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-adcf7af3-4c32-4fb8-82c7-be604c4cac0f tempest-VolumesExtendTest-1292632069 None] Lock "cinder-11ee8717-df16-4639-bc40-311ee346f552-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Acquiring lock "cinder-7193e5db-a9ca-4015-a5ad-fafe9cb64743-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Lock "cinder-7193e5db-a9ca-4015-a5ad-fafe9cb64743-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Acquiring lock "cinder-quobyte-7193e5db-a9ca-4015-a5ad-fafe9cb64743" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Lock "cinder-quobyte-7193e5db-a9ca-4015-a5ad-fafe9cb64743" acquired by "delete_volume" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:44 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8019225-0046-455c-b429-78b617baf3b6]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:45 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 Jul 21 19:16:45 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:45 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743" returned: 0 in 0.364s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:45 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743 Jul 21 19:16:45 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:45 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7193e5db-a9ca-4015-a5ad-fafe9cb64743" returned: 0 in 0.244s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Lock "cinder-quobyte-7193e5db-a9ca-4015-a5ad-fafe9cb64743" released by "delete_volume" :: held 0.664s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:45 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=59,cinder:UPDATE=52,cinder:DELETE=4,cinder:INSERT=15 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:16:45 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Created reservations ['f62fe372-4242-4821-a416-413915103df9', '469a52e7-e87f-43c5-98e2-f6bac4602cfe', '11d3da1f-fefc-45df-954b-4bdec09fb1e2', 'b9fbd6a8-a80e-494d-81ee-259189717e17'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:45 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:16:45 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:45 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.272s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:45 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:45 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Deleted volume successfully. Jul 21 19:16:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f35cbe0a-575f-4299-9be5-b2bc8e41ee79 tempest-VolumesExtendTest-1292632069 None] Lock "cinder-7193e5db-a9ca-4015-a5ad-fafe9cb64743-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:48 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Flow 'volume_create_manager' (c3efbbbb-b796-46fd-9ce1-aad71df1046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d8559e-4035-45f9-9299-f5004063eb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d8559e-4035-45f9-9299-f5004063eb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1256823050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f572a987-5931-48e8-83de-2d165f75d0a1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6f5fa5c177c4e6cbb79982ed8889355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:49Z,use_quota=True,user_id='abb3735cbfc14d50af54268e279c7178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1533bc89-3ec8-4b06-b259-a407d4097329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1533bc89-3ec8-4b06-b259-a407d4097329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b2c341-c28f-49a6-9ba0-f244b84307d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b2c341-c28f-49a6-9ba0-f244b84307d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f572a987-5931-48e8-83de-2d165f75d0a1', 'volume_name': 'volume-f572a987-5931-48e8-83de-2d165f75d0a1', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00051ca-c056-4901-9697-ad2dae94c8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00051ca-c056-4901-9697-ad2dae94c8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be09bc14-6e68-47d4-a39b-6d1befe52302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:49 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Volume f572a987-5931-48e8-83de-2d165f75d0a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f572a987-5931-48e8-83de-2d165f75d0a1', 'volume_size': 1} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1256823050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f572a987-5931-48e8-83de-2d165f75d0a1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6f5fa5c177c4e6cbb79982ed8889355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:49Z,use_quota=True,user_id='abb3735cbfc14d50af54268e279c7178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Creating volume f572a987-5931-48e8-83de-2d165f75d0a1 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:49 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f572a987-5931-48e8-83de-2d165f75d0a1 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:49 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f572a987-5931-48e8-83de-2d165f75d0a1 1073741824 Jul 21 19:16:49 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:49 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f572a987-5931-48e8-83de-2d165f75d0a1 1073741824" returned: 0 in 0.424s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f572a987-5931-48e8-83de-2d165f75d0a1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:49 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f572a987-5931-48e8-83de-2d165f75d0a1 Jul 21 19:16:49 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:49 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f572a987-5931-48e8-83de-2d165f75d0a1" returned: 0 in 0.264s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be09bc14-6e68-47d4-a39b-6d1befe52302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f572a987-5931-48e8-83de-2d165f75d0a1', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e012e54b-4afb-41b5-ad4f-64d05e9c7293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:49 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Volume volume-f572a987-5931-48e8-83de-2d165f75d0a1 (f572a987-5931-48e8-83de-2d165f75d0a1): created successfully Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e012e54b-4afb-41b5-ad4f-64d05e9c7293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Flow 'volume_create_manager' (c3efbbbb-b796-46fd-9ce1-aad71df1046b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:49 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-43c8364b-1c88-4fff-a34d-310d21bd336e tempest-VolumesGetTest-1854546639 None] Created volume successfully. Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Flow 'volume_create_manager' (21aa97f9-9632-480c-ab4b-db550d4cfe09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f23bc8-411b-4585-96c3-dc5849b7b3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f23bc8-411b-4585-96c3-dc5849b7b3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-106490293',display_name='tempest-VolumesGetTest-Volume-1994747057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa206f1e-fb75-49b6-a088-f1fc0febd4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f5fa5c177c4e6cbb79982ed8889355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:51Z,use_quota=True,user_id='abb3735cbfc14d50af54268e279c7178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2966be55-4fd9-43e3-bf35-61b3945b3105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2966be55-4fd9-43e3-bf35-61b3945b3105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c382f6e4-b998-4d80-88df-efd2b7faeb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c382f6e4-b998-4d80-88df-efd2b7faeb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa206f1e-fb75-49b6-a088-f1fc0febd4fe', 'volume_name': 'volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e4f405-67b2-4cc3-961d-c03ea2bf1296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e4f405-67b2-4cc3-961d-c03ea2bf1296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce9a0d5-42a0-4b36-b479-b41d6c9b17c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:50 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Volume aa206f1e-fb75-49b6-a088-f1fc0febd4fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe', 'volume_size': 1} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-106490293',display_name='tempest-VolumesGetTest-Volume-1994747057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa206f1e-fb75-49b6-a088-f1fc0febd4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f5fa5c177c4e6cbb79982ed8889355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:51Z,use_quota=True,user_id='abb3735cbfc14d50af54268e279c7178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Creating volume aa206f1e-fb75-49b6-a088-f1fc0febd4fe {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:50 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:16:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:50 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe 1073741824 Jul 21 19:16:50 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:51 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe 1073741824" returned: 0 in 0.403s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:51 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe Jul 21 19:16:51 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:51 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe" returned: 0 in 0.247s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce9a0d5-42a0-4b36-b479-b41d6c9b17c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e0dcf2-a75c-459d-a5d5-b783bd805482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:51 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Volume volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe (aa206f1e-fb75-49b6-a088-f1fc0febd4fe): created successfully Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e0dcf2-a75c-459d-a5d5-b783bd805482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Flow 'volume_create_manager' (21aa97f9-9632-480c-ab4b-db550d4cfe09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:51 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-aa2eb580-0506-4766-b53d-63ad2a60695d tempest-VolumesGetTest-1854546639 None] Created volume successfully. Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-aa206f1e-fb75-49b6-a088-f1fc0febd4fe-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Lock "cinder-aa206f1e-fb75-49b6-a088-f1fc0febd4fe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-quobyte-aa206f1e-fb75-49b6-a088-f1fc0febd4fe" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-aa206f1e-fb75-49b6-a088-f1fc0febd4fe" acquired by "delete_volume" :: waited 0.013s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd87658-b9e0-4201-9699-b66d08d48806]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:51 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe Jul 21 19:16:51 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:52 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe" returned: 0 in 0.387s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:52 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe Jul 21 19:16:52 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:52 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-aa206f1e-fb75-49b6-a088-f1fc0febd4fe" returned: 0 in 0.275s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-aa206f1e-fb75-49b6-a088-f1fc0febd4fe" released by "delete_volume" :: held 0.709s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:52 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Created reservations ['23864960-4041-4c38-a877-068b18549a90', '59e83691-bd15-4ba2-862c-ada74940a446', '64a93b3a-896d-46c1-b2b3-7005436b5d8d', '9228ead9-f1dd-417b-af10-bcfddf6963d7'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:52 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:16:52 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:52 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.254s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:52 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:52 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Deleted volume successfully. Jul 21 19:16:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-21901338-6cbf-4fdd-95fd-48e9e59ed3e1 tempest-VolumesGetTest-1854546639 None] Lock "cinder-aa206f1e-fb75-49b6-a088-f1fc0febd4fe-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-f572a987-5931-48e8-83de-2d165f75d0a1-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Lock "cinder-f572a987-5931-48e8-83de-2d165f75d0a1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-quobyte-f572a987-5931-48e8-83de-2d165f75d0a1" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-f572a987-5931-48e8-83de-2d165f75d0a1" acquired by "delete_volume" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6b6821-64ff-4ee4-ac36-efc48bee41c6]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f572a987-5931-48e8-83de-2d165f75d0a1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:53 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f572a987-5931-48e8-83de-2d165f75d0a1 Jul 21 19:16:53 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:53 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f572a987-5931-48e8-83de-2d165f75d0a1" returned: 0 in 0.381s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f572a987-5931-48e8-83de-2d165f75d0a1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:53 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f572a987-5931-48e8-83de-2d165f75d0a1 Jul 21 19:16:53 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:53 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f572a987-5931-48e8-83de-2d165f75d0a1" returned: 0 in 0.263s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-f572a987-5931-48e8-83de-2d165f75d0a1" released by "delete_volume" :: held 0.686s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Created reservations ['603be793-e4ba-476e-acf4-25b90c9da03d', 'd20cb059-4f20-4ee7-b84c-8edb67503e47', '513fa0de-94c0-4a2c-84bf-860a829291fe', '1179242e-bfed-432e-9df3-f059f1ac8542'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:53 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:16:53 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:54 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.281s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:54 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Deleted volume successfully. Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c1792179-2014-45d5-9a6e-2693a62d3778 tempest-VolumesGetTest-1854546639 None] Lock "cinder-f572a987-5931-48e8-83de-2d165f75d0a1-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=75,cinder:UPDATE=89,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Flow 'volume_create_manager' (0e1b24e7-af7e-45a1-a693-53cd268c23a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4297ad88-20fd-40f7-9bd4-ab56a6db92e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4297ad88-20fd-40f7-9bd4-ab56a6db92e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1056239191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ed5e4a-230d-4b2e-b888-3f6e66f8a782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f5fa5c177c4e6cbb79982ed8889355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:55Z,use_quota=True,user_id='abb3735cbfc14d50af54268e279c7178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4b6fdc-58c5-4dac-8012-32ff75efc338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4b6fdc-58c5-4dac-8012-32ff75efc338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273309b2-62a5-480a-ab01-2af817fdf894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273309b2-62a5-480a-ab01-2af817fdf894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ed5e4a-230d-4b2e-b888-3f6e66f8a782', 'volume_name': 'volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20689f53-67f5-47af-b828-2d16994c609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20689f53-67f5-47af-b828-2d16994c609a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b377f4a-5df7-4e2b-9261-23ef1868bb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:54 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Volume a2ed5e4a-230d-4b2e-b888-3f6e66f8a782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782', 'volume_size': 1} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1056239191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ed5e4a-230d-4b2e-b888-3f6e66f8a782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f5fa5c177c4e6cbb79982ed8889355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:55Z,use_quota=True,user_id='abb3735cbfc14d50af54268e279c7178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Creating volume a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:54 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:16:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:54 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 1073741824 Jul 21 19:16:54 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:55 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 1073741824" returned: 0 in 0.453s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:55 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 Jul 21 19:16:55 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:55 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782" returned: 0 in 0.254s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b377f4a-5df7-4e2b-9261-23ef1868bb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb13192d-77ce-4c14-b1dd-03a463ef0e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:55 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Volume volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 (a2ed5e4a-230d-4b2e-b888-3f6e66f8a782): created successfully Jul 21 19:16:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb13192d-77ce-4c14-b1dd-03a463ef0e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Flow 'volume_create_manager' (0e1b24e7-af7e-45a1-a693-53cd268c23a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:55 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ba9c9c8c-ea2f-4e96-8b69-75dd1f6beb5e tempest-VolumesGetTest-1854546639 None] Created volume successfully. Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Flow 'volume_create_manager' (c805dfd3-aa67-4e0f-8361-b3e9a7adae06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38bd152-d0e3-4507-a1c0-2dc54bf90507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38bd152-d0e3-4507-a1c0-2dc54bf90507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-304418444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e847573-8dd8-47ca-97ed-9844014ba804,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6f5fa5c177c4e6cbb79982ed8889355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a2ed5e4a-230d-4b2e-b888-3f6e66f8a782,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:56Z,use_quota=True,user_id='abb3735cbfc14d50af54268e279c7178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0877773c-a9c9-48ac-b96b-774bcf2c196f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0877773c-a9c9-48ac-b96b-774bcf2c196f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ff6bad-498a-492c-8410-234470221fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ff6bad-498a-492c-8410-234470221fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8e847573-8dd8-47ca-97ed-9844014ba804', 'volume_name': 'volume-8e847573-8dd8-47ca-97ed-9844014ba804', 'volume_size': 1, 'source_volid': 'a2ed5e4a-230d-4b2e-b888-3f6e66f8a782', 'source_volstatus': 'available'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4fa084-b857-47c2-89d6-c4977b9493b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4fa084-b857-47c2-89d6-c4977b9493b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673646a4-bb84-42f9-a6a9-a69821f81250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:56 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Volume 8e847573-8dd8-47ca-97ed-9844014ba804: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8e847573-8dd8-47ca-97ed-9844014ba804', 'volume_size': 1, 'source_volid': 'a2ed5e4a-230d-4b2e-b888-3f6e66f8a782', 'source_volstatus': 'available'} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:56 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Cloning volume a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 to volume 8e847573-8dd8-47ca-97ed-9844014ba804 Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Creating offline snapshot 254910a5-0653-4e76-a53c-ca951301a721 of volume a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eca0cd6-d68b-443c-ba92-3480d7f04d7d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:56 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 Jul 21 19:16:56 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:56 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782" returned: 0 in 0.369s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:56 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 1G Jul 21 19:16:56 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:57 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 1G" returned: 0 in 0.432s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:57 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 Jul 21 19:16:57 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:57 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721" returned: 0 in 0.286s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:57 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 is being set with open permissions: ugo+rw Jul 21 19:16:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:57 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 Jul 21 19:16:57 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:57 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721" returned: 0 in 0.233s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:57 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.info Jul 21 19:16:57 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:57 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.info" returned: 0 in 0.271s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:57 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.info is being set with open permissions: ugo+rw Jul 21 19:16:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:58 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.info Jul 21 19:16:58 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:58 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.info" returned: 0 in 0.283s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-quobyte-8e847573-8dd8-47ca-97ed-9844014ba804" by "_copy_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-8e847573-8dd8-47ca-97ed-9844014ba804" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] snapshot: 254910a5-0653-4e76-a53c-ca951301a721, volume: 8e847573-8dd8-47ca-97ed-9844014ba804, {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cb59de-7fa7-4e4c-aaf9-a0db44b8ffa9]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:58 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 Jul 21 19:16:58 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:58 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721" returned: 0 in 0.370s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Creating direct copy from snapshot {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce77dda0-97a0-4bd5-9046-c3b1a515b051]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:58 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 Jul 21 19:16:58 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:59 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782" returned: 0 in 0.402s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:59 devstack cinder-volume[87487]: DEBUG cinder.utils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Path /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804 not found in is_blk_device check {{(pid=87487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:16:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:59 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804 Jul 21 19:16:59 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:03 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804" returned: 0 in 4.001s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:03 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fe6f1d-7aff-4178-a463-594003cfb2a0]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:03 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 Jul 21 19:17:03 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:03 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782" returned: 0 in 0.521s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:03 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782, size 1024.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:17:03 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Converted 1024.00 MB image at 255.87 MB/s Jul 21 19:17:03 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804 is being set with open permissions: ugo+rw Jul 21 19:17:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:03 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804 Jul 21 19:17:03 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:03 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804" returned: 0 in 0.239s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-8e847573-8dd8-47ca-97ed-9844014ba804" released by "_copy_volume_from_snapshot" :: held 5.608s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-quobyte-254910a5-0653-4e76-a53c-ca951301a721" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-254910a5-0653-4e76-a53c-ca951301a721" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Deleting offline snapshot 254910a5-0653-4e76-a53c-ca951301a721 of volume a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:17:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] snapshot_file for this snap is: volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:17:03 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1b6455-be9b-488a-a529-0c899d89904a]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:04 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 Jul 21 19:17:04 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:04 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721" returned: 0 in 0.384s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:17:04 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a80d018-9992-420a-8ab9-2cbb2882cc98]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:04 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 Jul 21 19:17:04 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:04 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782" returned: 0 in 0.382s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:04 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 Jul 21 19:17:04 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-ff713c0a-3286-4da0-af2c-a9792c3623b0 req-dd84cdfc-cad6-4ec5-b03b-f887e89b3094 tempest-TestStampPattern-1917288352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:05 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721" returned: 0 in 0.378s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:05 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721 Jul 21 19:17:05 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:05 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782.254910a5-0653-4e76-a53c-ca951301a721" returned: 0 in 0.240s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-254910a5-0653-4e76-a53c-ca951301a721" released by "_delete_snapshot" :: held 1.473s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.126s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-ff713c0a-3286-4da0-af2c-a9792c3623b0 req-dd84cdfc-cad6-4ec5-b03b-f887e89b3094 tempest-TestStampPattern-1917288352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.311s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673646a4-bb84-42f9-a6a9-a69821f81250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e847573-8dd8-47ca-97ed-9844014ba804', 'volume_size': 1, 'source_volid': 'a2ed5e4a-230d-4b2e-b888-3f6e66f8a782', 'source_volstatus': 'available'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6a23b2-0c57-4902-b4bf-f09549c91002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bfc4b1-4cb7-4174-9f9a-4195b46905bc]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-ff713c0a-3286-4da0-af2c-a9792c3623b0 req-dd84cdfc-cad6-4ec5-b03b-f887e89b3094 tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:05 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Volume volume-8e847573-8dd8-47ca-97ed-9844014ba804 (8e847573-8dd8-47ca-97ed-9844014ba804): created successfully Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6a23b2-0c57-4902-b4bf-f09549c91002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Flow 'volume_create_manager' (c805dfd3-aa67-4e0f-8361-b3e9a7adae06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-02894484-8316-40d5-8787-a90840a53842 tempest-VolumesGetTest-1854546639 None] Created volume successfully. Jul 21 19:17:05 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48 Jul 21 19:17:05 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:05 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [req-ff713c0a-3286-4da0-af2c-a9792c3623b0 req-dd84cdfc-cad6-4ec5-b03b-f887e89b3094 tempest-TestStampPattern-1917288352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48" returned: 0 in 0.355s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [req-ff713c0a-3286-4da0-af2c-a9792c3623b0 req-dd84cdfc-cad6-4ec5-b03b-f887e89b3094 tempest-TestStampPattern-1917288352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.384s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-ff713c0a-3286-4da0-af2c-a9792c3623b0 req-dd84cdfc-cad6-4ec5-b03b-f887e89b3094 tempest-TestStampPattern-1917288352 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77', 'name': 'volume-8125b5be-7b92-4343-8f35-ede96de79a48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01b0300b-6936-488b-8329-9f62080a3d75', 'enforce_multipath': True} {{(pid=87487) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:17:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-ff713c0a-3286-4da0-af2c-a9792c3623b0 req-dd84cdfc-cad6-4ec5-b03b-f887e89b3094 tempest-TestStampPattern-1917288352 None] attachment_update completed successfully. Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Flow 'volume_create_manager' (adc17f52-8b35-47a0-a8fd-853487f400ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d23c42-8a19-44e2-af1b-236b68c2205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d23c42-8a19-44e2-af1b-236b68c2205b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1774628282',display_name='tempest-VolumesGetTest-Volume-1720897925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa045f5-f8ff-4501-b819-d295dc2362cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f5fa5c177c4e6cbb79982ed8889355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:07Z,use_quota=True,user_id='abb3735cbfc14d50af54268e279c7178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9e0bdb-a15a-4962-9e54-18a22179a3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9e0bdb-a15a-4962-9e54-18a22179a3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1967cd7c-fc1e-468b-97da-d0ffb3543b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1967cd7c-fc1e-468b-97da-d0ffb3543b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa045f5-f8ff-4501-b819-d295dc2362cc', 'volume_name': 'volume-9fa045f5-f8ff-4501-b819-d295dc2362cc', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd887b9-7d35-4f83-8e1b-ea45456d4541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd887b9-7d35-4f83-8e1b-ea45456d4541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec85ff2-8dee-448a-aca4-cc562a228444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:06 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Volume 9fa045f5-f8ff-4501-b819-d295dc2362cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa045f5-f8ff-4501-b819-d295dc2362cc', 'volume_size': 1} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1774628282',display_name='tempest-VolumesGetTest-Volume-1720897925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa045f5-f8ff-4501-b819-d295dc2362cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f5fa5c177c4e6cbb79982ed8889355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:07Z,use_quota=True,user_id='abb3735cbfc14d50af54268e279c7178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Creating volume 9fa045f5-f8ff-4501-b819-d295dc2362cc {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:06 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9fa045f5-f8ff-4501-b819-d295dc2362cc 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:06 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9fa045f5-f8ff-4501-b819-d295dc2362cc 1073741824 Jul 21 19:17:06 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:07 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9fa045f5-f8ff-4501-b819-d295dc2362cc 1073741824" returned: 0 in 0.416s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9fa045f5-f8ff-4501-b819-d295dc2362cc {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:07 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9fa045f5-f8ff-4501-b819-d295dc2362cc Jul 21 19:17:07 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:07 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9fa045f5-f8ff-4501-b819-d295dc2362cc" returned: 0 in 0.277s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:07 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:07 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec85ff2-8dee-448a-aca4-cc562a228444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa045f5-f8ff-4501-b819-d295dc2362cc', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:07 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e34001-f34a-482e-94c9-b9b9d569b0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:07 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Volume volume-9fa045f5-f8ff-4501-b819-d295dc2362cc (9fa045f5-f8ff-4501-b819-d295dc2362cc): created successfully Jul 21 19:17:07 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e34001-f34a-482e-94c9-b9b9d569b0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:07 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Flow 'volume_create_manager' (adc17f52-8b35-47a0-a8fd-853487f400ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:07 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-212c648e-0d7f-4fca-bc63-dd86efdeb7aa tempest-VolumesGetTest-1854546639 None] Created volume successfully. Jul 21 19:17:08 devstack cinder-volume[87487]: INFO cinder.volume.manager [req-35c411e3-5020-48eb-9ae1-dad06150a912 req-4683b325-2ff0-4e00-9925-860be3998478 tempest-TestStampPattern-1917288352 None] Terminate volume connection completed successfully. Jul 21 19:17:08 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [req-35c411e3-5020-48eb-9ae1-dad06150a912 req-4683b325-2ff0-4e00-9925-860be3998478 tempest-TestStampPattern-1917288352 None] Deleting attachment 01b0300b-6936-488b-8329-9f62080a3d75. {{(pid=87487) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:17:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-9fa045f5-f8ff-4501-b819-d295dc2362cc-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Lock "cinder-9fa045f5-f8ff-4501-b819-d295dc2362cc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-quobyte-9fa045f5-f8ff-4501-b819-d295dc2362cc" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-9fa045f5-f8ff-4501-b819-d295dc2362cc" acquired by "delete_volume" :: waited 0.014s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:08 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a55c4a-935d-4dc7-99f3-72b95e6422ce]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9fa045f5-f8ff-4501-b819-d295dc2362cc {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:09 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9fa045f5-f8ff-4501-b819-d295dc2362cc Jul 21 19:17:09 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:09 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9fa045f5-f8ff-4501-b819-d295dc2362cc" returned: 0 in 0.362s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9fa045f5-f8ff-4501-b819-d295dc2362cc {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:09 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9fa045f5-f8ff-4501-b819-d295dc2362cc Jul 21 19:17:09 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:09 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9fa045f5-f8ff-4501-b819-d295dc2362cc" returned: 0 in 0.245s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-9fa045f5-f8ff-4501-b819-d295dc2362cc" released by "delete_volume" :: held 0.645s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:09 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Created reservations ['b011ef4c-e55b-4d87-9086-26b6daf19f06', 'd2fb3732-dffd-4000-8c76-bc9fd81ae9d5', '9ce07c6c-4289-41d8-9094-23d36971919e', '04aaa8a5-8549-40da-be41-f48826ff7541'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:09 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:17:09 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:10 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.319s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:10 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:10 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Deleted volume successfully. Jul 21 19:17:10 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a332f10d-8856-4f6e-a934-37e11f7679bf tempest-VolumesGetTest-1854546639 None] Lock "cinder-9fa045f5-f8ff-4501-b819-d295dc2362cc-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:10 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-8e847573-8dd8-47ca-97ed-9844014ba804-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:10 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Lock "cinder-8e847573-8dd8-47ca-97ed-9844014ba804-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:10 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-quobyte-8e847573-8dd8-47ca-97ed-9844014ba804" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:10 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-8e847573-8dd8-47ca-97ed-9844014ba804" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:10 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86536f0-74c3-46a1-a28f-891a1791e6b8]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:10 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804 Jul 21 19:17:10 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:10 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804" returned: 0 in 0.509s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:10 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804 Jul 21 19:17:10 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:11 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8e847573-8dd8-47ca-97ed-9844014ba804" returned: 0 in 0.322s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-8e847573-8dd8-47ca-97ed-9844014ba804" released by "delete_volume" :: held 0.892s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Created reservations ['a44204a3-8c96-490c-a690-97fcabfbe304', 'cdb4fad0-a015-4bfd-a6c3-7f5e11ba9acd', 'ca85f811-928c-43eb-a544-c6686f888c94', 'f8347b48-4a65-42f0-b8db-47b645d6ca57'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:11 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:17:11 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Lock "cinder-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-quobyte-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782" acquired by "delete_volume" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3ce924-46a8-4940-bd28-3191425a93ee]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:11 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:11 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 Jul 21 19:17:11 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.408s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:11 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Deleted volume successfully. Jul 21 19:17:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-39b35da5-a43c-447d-8ca6-d2888c81b66d tempest-VolumesGetTest-1854546639 None] Lock "cinder-8e847573-8dd8-47ca-97ed-9844014ba804-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:12 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782" returned: 0 in 0.447s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:12 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782 Jul 21 19:17:12 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:12 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782" returned: 0 in 0.285s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:12 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782" released by "delete_volume" :: held 0.817s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:12 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Created reservations ['ea33de43-5786-4da7-b4e5-174a31404f9a', 'ff05cddf-8508-4c5d-84d6-e56630b127f3', '340bd2d0-496e-4bca-8230-6d70bd9c23ea', '25c1ec1d-c3ed-4fb2-b578-6650a6c6e5b0'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:12 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:17:12 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:12 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.266s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:12 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:12 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Deleted volume successfully. Jul 21 19:17:12 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bdca1fb3-61df-4a6b-a2f1-f23c0adaf07e tempest-VolumesGetTest-1854546639 None] Lock "cinder-a2ed5e4a-230d-4b2e-b888-3f6e66f8a782-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Acquiring lock "cinder-8125b5be-7b92-4343-8f35-ede96de79a48-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Lock "cinder-8125b5be-7b92-4343-8f35-ede96de79a48-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Acquiring lock "cinder-quobyte-8125b5be-7b92-4343-8f35-ede96de79a48" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Lock "cinder-quobyte-8125b5be-7b92-4343-8f35-ede96de79a48" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[965abe6a-3c32-4890-bed7-4b922d2ed083]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:13 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48 Jul 21 19:17:13 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Flow 'volume_create_manager' (be323635-40d6-499b-a254-d9fdec03fd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13762aec-a6e4-447e-879a-d2ac9f0059ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13762aec-a6e4-447e-879a-d2ac9f0059ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1735940525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9225747c-2e1b-4f15-9469-0ac07173956f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6f5fa5c177c4e6cbb79982ed8889355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:13Z,use_quota=True,user_id='abb3735cbfc14d50af54268e279c7178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63486ebf-0fcc-4d8b-9812-c4c2bd3ba4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63486ebf-0fcc-4d8b-9812-c4c2bd3ba4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86a274b-78d7-4f90-a892-46095bfcfa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.image.glance [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Creating Keystone auth plugin from conf {{(pid=87487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:17:13 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48" returned: 0 in 0.397s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:13 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48 Jul 21 19:17:13 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86a274b-78d7-4f90-a892-46095bfcfa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9225747c-2e1b-4f15-9469-0ac07173956f', 'volume_name': 'volume-9225747c-2e1b-4f15-9469-0ac07173956f', 'volume_size': 1, 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3621f130346745d7901341d043a6da99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'created_at': datetime.datetime(2026, 7, 21, 16, 56, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc66b18b-6093-4756-9dba-09c30714a99f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb22f96e-645c-4728-b0b3-f0876168b325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb22f96e-645c-4728-b0b3-f0876168b325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164c00de-c0d8-4112-acb9-cba42c6954b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:13 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Volume 9225747c-2e1b-4f15-9469-0ac07173956f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9225747c-2e1b-4f15-9469-0ac07173956f', 'volume_size': 1, 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3621f130346745d7901341d043a6da99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'created_at': datetime.datetime(2026, 7, 21, 16, 56, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc66b18b-6093-4756-9dba-09c30714a99f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Trying to clone 9225747c-2e1b-4f15-9469-0ac07173956f from image cc66b18b-6093-4756-9dba-09c30714a99f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]). {{(pid=87487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:17:13 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-8125b5be-7b92-4343-8f35-ede96de79a48" returned: 0 in 0.290s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Lock "cinder-quobyte-8125b5be-7b92-4343-8f35-ede96de79a48" released by "delete_volume" :: held 0.742s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Created reservations ['3b39b709-9c4a-44e2-b90d-0169acf06c95', 'b9df1f66-8b49-42eb-b1ea-9086bf3c0c3b', 'cb2c83de-d53e-46e4-b3b8-6994db5fe685', '52cf4e82-b146-4705-b4af-38d57e43a1fa'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_j1u210bmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:17:14 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Image download 20.69 MB at 20.69 MB/s Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3fb55c-91df-42be-94db-4d054328b8a0]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_j1u210bmdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:14 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:17:14 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:14 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_j1u210bmdevstack@QuobyteHD Jul 21 19:17:14 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:14 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.288s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:14 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Deleted volume successfully. Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9da17ae1-d17f-4bbc-a8bb-0272791d9f5a tempest-TestStampPattern-1917288352 None] Lock "cinder-8125b5be-7b92-4343-8f35-ede96de79a48-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:14 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_j1u210bmdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Temporary image cc66b18b-6093-4756-9dba-09c30714a99f is fetched for user abb3735cbfc14d50af54268e279c7178. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab894216-98ce-4444-9499-a676a8e7cb4c]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_j1u210bmdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Acquiring lock "cinder-1c77af0b-863d-41f3-97d2-146fae0c090d-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Lock "cinder-1c77af0b-863d-41f3-97d2-146fae0c090d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Acquiring lock "cinder-quobyte-d7775ccd-c398-4a91-9cd8-2a3b775d9080" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Lock "cinder-quobyte-d7775ccd-c398-4a91-9cd8-2a3b775d9080" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Acquiring lock "cinder-quobyte-1c77af0b-863d-41f3-97d2-146fae0c090d" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Lock "cinder-quobyte-1c77af0b-863d-41f3-97d2-146fae0c090d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Deleting offline snapshot 1c77af0b-863d-41f3-97d2-146fae0c090d of volume d7775ccd-c398-4a91-9cd8-2a3b775d9080 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] snapshot_file for this snap is: volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e7bb0e-9fdf-48c2-acae-b45ca6cb648b]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:14 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_j1u210bmdevstack@QuobyteHD Jul 21 19:17:14 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:14 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d Jul 21 19:17:14 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:15 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_j1u210bmdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1735940525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9225747c-2e1b-4f15-9469-0ac07173956f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6f5fa5c177c4e6cbb79982ed8889355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:13Z,use_quota=True,user_id='abb3735cbfc14d50af54268e279c7178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Creating volume 9225747c-2e1b-4f15-9469-0ac07173956f {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:15 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:15 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f 1073741824 Jul 21 19:17:15 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:15 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d" returned: 0 in 0.369s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14ec662-c282-4d81-868e-fa0b8e0a69ff]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:15 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 Jul 21 19:17:15 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:15 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f 1073741824" returned: 0 in 0.458s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:15 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f Jul 21 19:17:15 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:15 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080" returned: 0 in 0.409s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:15 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d Jul 21 19:17:15 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:15 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f" returned: 0 in 0.274s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Attempting download of cc66b18b-6093-4756-9dba-09c30714a99f ((None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}])) to volume 9225747c-2e1b-4f15-9469-0ac07173956f. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c755c26-5cb4-4d12-add0-4b5acbcb25a4]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_m_xn5elz {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:16 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d" returned: 0 in 0.381s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:16 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d Jul 21 19:17:16 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:16 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_m_xn5elz Jul 21 19:17:16 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:16 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080.1c77af0b-863d-41f3-97d2-146fae0c090d" returned: 0 in 0.245s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:16 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_m_xn5elz" returned: 0 in 0.352s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_m_xn5elz {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Lock "cinder-quobyte-1c77af0b-863d-41f3-97d2-146fae0c090d" released by "_delete_snapshot" :: held 1.517s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Lock "cinder-quobyte-d7775ccd-c398-4a91-9cd8-2a3b775d9080" released by "delete_snapshot" :: held 1.541s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Created reservations ['d037486f-c7da-4ff4-ad43-3821ef52de24', 'afdcec8f-29c9-453a-9ff9-016624af1141', 'c461484c-676e-4c8b-9d70-226edf2a7a02', 'f38b5275-4eab-4473-a99b-92660e788ef9'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:16 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_m_xn5elz Jul 21 19:17:16 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:16 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Delete snapshot completed successfully. Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7034cbb1-fa11-4481-81e6-fb8354732aec tempest-TestStampPattern-1917288352 None] Lock "cinder-1c77af0b-863d-41f3-97d2-146fae0c090d-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:16 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_m_xn5elz" returned: 1 in 0.340s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc66b18b-6093-4756-9dba-09c30714a99f_m_xn5elz' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f5c429-a2d5-43ed-991b-4287dcce8e4c]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_j1u210bmdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:16 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_j1u210bmdevstack@QuobyteHD Jul 21 19:17:16 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:16 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_j1u210bmdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] cc66b18b-6093-4756-9dba-09c30714a99f was qcow2, converting to qcow2 {{(pid=87487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:17:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_j1u210bmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:17 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_j1u210bmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f Jul 21 19:17:17 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:19 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_j1u210bmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f" returned: 0 in 2.309s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:19 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cc66b18b-6093-4756-9dba-09c30714a99f_j1u210bmdevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:17:19 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Converted 112.00 MB image at 48.47 MB/s Jul 21 19:17:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:19 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f 1G Jul 21 19:17:19 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:19 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f 1G" returned: 0 in 0.403s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:19 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Downloaded image cc66b18b-6093-4756-9dba-09c30714a99f ((None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}])) to volume 9225747c-2e1b-4f15-9469-0ac07173956f successfully. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:17:19 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Temporary image cc66b18b-6093-4756-9dba-09c30714a99f for user abb3735cbfc14d50af54268e279c7178 is deleted. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:17:19 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Marking volume 9225747c-2e1b-4f15-9469-0ac07173956f as bootable. {{(pid=87487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:17:19 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Copying metadata from image cc66b18b-6093-4756-9dba-09c30714a99f to 9225747c-2e1b-4f15-9469-0ac07173956f. {{(pid=87487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:17:19 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Creating volume glance metadata for volume 9225747c-2e1b-4f15-9469-0ac07173956f backed by image cc66b18b-6093-4756-9dba-09c30714a99f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:17:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164c00de-c0d8-4112-acb9-cba42c6954b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9225747c-2e1b-4f15-9469-0ac07173956f', 'volume_size': 1, 'image_id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc66b18b-6093-4756-9dba-09c30714a99f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3621f130346745d7901341d043a6da99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc66b18b-6093-4756-9dba-09c30714a99f', 'created_at': datetime.datetime(2026, 7, 21, 16, 56, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 56, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc66b18b-6093-4756-9dba-09c30714a99f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f68c284-ea55-4091-9c9f-cc1a4c142095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:19 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Volume volume-9225747c-2e1b-4f15-9469-0ac07173956f (9225747c-2e1b-4f15-9469-0ac07173956f): created successfully Jul 21 19:17:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f68c284-ea55-4091-9c9f-cc1a4c142095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Flow 'volume_create_manager' (be323635-40d6-499b-a254-d9fdec03fd0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:19 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9808bd66-e007-4e30-8f0f-a3d910d84b27 tempest-VolumesGetTest-1854546639 None] Created volume successfully. Jul 21 19:17:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Acquiring lock "cinder-d7775ccd-c398-4a91-9cd8-2a3b775d9080-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Lock "cinder-d7775ccd-c398-4a91-9cd8-2a3b775d9080-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Acquiring lock "cinder-quobyte-d7775ccd-c398-4a91-9cd8-2a3b775d9080" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Lock "cinder-quobyte-d7775ccd-c398-4a91-9cd8-2a3b775d9080" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:20 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d01530-b5a5-48ea-8dc7-b44fc58c1bdd]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:20 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 Jul 21 19:17:20 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:21 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080" returned: 0 in 0.376s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:21 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080 Jul 21 19:17:21 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:21 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d7775ccd-c398-4a91-9cd8-2a3b775d9080" returned: 0 in 0.286s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Lock "cinder-quobyte-d7775ccd-c398-4a91-9cd8-2a3b775d9080" released by "delete_volume" :: held 0.725s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Created reservations ['e2db9c1b-da3e-404a-925c-2dea5c41e05a', '7934ebf7-e3c9-4ea4-a4d7-356675ff4543', '5fc36373-ddb2-47e2-9e4b-4771a3c0bb28', '6086b785-8494-4943-b3ca-08cbae182a0c'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:21 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:17:21 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Flow 'volume_create_manager' (28a3cc36-5f15-4a67-9e78-85716fa5e844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f8df29-066c-44a2-bd8e-f4d259e74845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f8df29-066c-44a2-bd8e-f4d259e74845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-785449640',display_name='tempest-VolumesGetTest-Volume-919827892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e85b92b-35ee-4ed6-bc42-0a9198edde39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f5fa5c177c4e6cbb79982ed8889355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:22Z,use_quota=True,user_id='abb3735cbfc14d50af54268e279c7178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65f5441-5bd4-41b4-a720-976ea143d993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65f5441-5bd4-41b4-a720-976ea143d993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf66dce6-dfe4-41e6-839b-93a6a90a5a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf66dce6-dfe4-41e6-839b-93a6a90a5a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e85b92b-35ee-4ed6-bc42-0a9198edde39', 'volume_name': 'volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b14a93-f30c-454d-a221-87ab9d85a83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b14a93-f30c-454d-a221-87ab9d85a83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02851eb5-147c-4921-84eb-f163ea59e6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:21 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Volume 7e85b92b-35ee-4ed6-bc42-0a9198edde39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39', 'volume_size': 1} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-785449640',display_name='tempest-VolumesGetTest-Volume-919827892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e85b92b-35ee-4ed6-bc42-0a9198edde39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f5fa5c177c4e6cbb79982ed8889355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:22Z,use_quota=True,user_id='abb3735cbfc14d50af54268e279c7178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Creating volume 7e85b92b-35ee-4ed6-bc42-0a9198edde39 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:21 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:21 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39 1073741824 Jul 21 19:17:21 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:21 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.273s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:21 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Deleted volume successfully. Jul 21 19:17:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f49410cd-5748-4554-88ec-7f22ed91bfa4 tempest-TestStampPattern-1917288352 None] Lock "cinder-d7775ccd-c398-4a91-9cd8-2a3b775d9080-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:22 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39 1073741824" returned: 0 in 0.504s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:22 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39 Jul 21 19:17:22 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:22 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39" returned: 0 in 0.257s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02851eb5-147c-4921-84eb-f163ea59e6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2fb7f3-a7e0-4f0a-b863-aae9ca056702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:22 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Volume volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39 (7e85b92b-35ee-4ed6-bc42-0a9198edde39): created successfully Jul 21 19:17:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2fb7f3-a7e0-4f0a-b863-aae9ca056702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Flow 'volume_create_manager' (28a3cc36-5f15-4a67-9e78-85716fa5e844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:22 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-dcea3e6f-a712-4bfd-a3a3-ecb635d42ad7 tempest-VolumesGetTest-1854546639 None] Created volume successfully. Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-7e85b92b-35ee-4ed6-bc42-0a9198edde39-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Lock "cinder-7e85b92b-35ee-4ed6-bc42-0a9198edde39-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-quobyte-7e85b92b-35ee-4ed6-bc42-0a9198edde39" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-7e85b92b-35ee-4ed6-bc42-0a9198edde39" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a1fa66-8bec-4dad-a7ef-046f09d69871]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:24 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39 Jul 21 19:17:24 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:24 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39" returned: 0 in 0.368s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:24 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39 Jul 21 19:17:24 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:24 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7e85b92b-35ee-4ed6-bc42-0a9198edde39" returned: 0 in 0.315s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-7e85b92b-35ee-4ed6-bc42-0a9198edde39" released by "delete_volume" :: held 0.740s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Created reservations ['1b906d68-6ac6-4da4-9e43-718c192e783d', 'c20c7569-7cc1-4b92-bfb9-1c28eeb77f07', '6347ad57-f8db-4afb-842f-9d9c25c72df8', 'ddc50905-b9b8-47cf-84ab-03d7f1f29149'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:24 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:17:25 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:25 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.301s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:25 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Deleted volume successfully. Jul 21 19:17:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-199d2539-952c-4694-a7b8-c32e5ceca11b tempest-VolumesGetTest-1854546639 None] Lock "cinder-7e85b92b-35ee-4ed6-bc42-0a9198edde39-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-9225747c-2e1b-4f15-9469-0ac07173956f-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Lock "cinder-9225747c-2e1b-4f15-9469-0ac07173956f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Acquiring lock "cinder-quobyte-9225747c-2e1b-4f15-9469-0ac07173956f" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-9225747c-2e1b-4f15-9469-0ac07173956f" acquired by "delete_volume" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:25 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d5885d-4fe7-4bd5-8d66-781616820298]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:25 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f Jul 21 19:17:25 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:25 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f" returned: 0 in 0.392s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:25 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f Jul 21 19:17:25 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:26 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-9225747c-2e1b-4f15-9469-0ac07173956f" returned: 0 in 0.279s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Lock "cinder-quobyte-9225747c-2e1b-4f15-9469-0ac07173956f" released by "delete_volume" :: held 0.713s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:26 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Created reservations ['97fab45e-045b-4edd-a4b6-49e1f44b25f2', '1f831618-7512-4480-9910-e4d365d985ae', '85fbc52f-03a9-4d76-b977-f1b2e07f3dbb', 'cfb67b6c-2774-4d11-bb54-c3ee2190d178'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:26 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:17:26 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:26 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.286s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:26 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:26 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Deleted volume successfully. Jul 21 19:17:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9cabfd35-535e-4ffb-8ab2-ab62866a08f9 tempest-VolumesGetTest-1854546639 None] Lock "cinder-9225747c-2e1b-4f15-9469-0ac07173956f-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:33 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Flow 'volume_create_manager' (d662c8b4-1797-407d-a62c-d0108d2ebf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad31f31-3461-4b06-919f-1306665d5f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad31f31-3461-4b06-919f-1306665d5f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31446b3-34f8-4dd7-8b79-286367a2650d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fcdac139c514db7b26fde583c523adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:34Z,use_quota=True,user_id='666c2328926f4934af45709b4df7e9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2897341-f88b-4d5a-9899-0c19bb6abe20),volume_type_id=d2897341-f88b-4d5a-9899-0c19bb6abe20)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ae5f08-f8a7-422a-ba0f-198e236b46bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ae5f08-f8a7-422a-ba0f-198e236b46bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e979f82-e684-4669-805a-cca9d2493f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:33 devstack cinder-volume[87487]: DEBUG cinder.image.glance [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Creating Keystone auth plugin from conf {{(pid=87487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:17:33 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Flow 'volume_create_manager' (c3502a4c-2b6c-43d6-8dd8-a6f9315c38da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8d379c-cea1-4610-89de-649efe93503f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8d379c-cea1-4610-89de-649efe93503f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1600393677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de135c60-607c-47fa-8cf4-06082197a828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65aefc940128418f9efe4ed5a5de5000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:34Z,use_quota=True,user_id='29e4688e3710407db40775b50da645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f14a28-ae36-4ead-9494-9cc7687aab27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f14a28-ae36-4ead-9494-9cc7687aab27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac7fc6a-d2b1-4137-9b81-1dd5b6201b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac7fc6a-d2b1-4137-9b81-1dd5b6201b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de135c60-607c-47fa-8cf4-06082197a828', 'volume_name': 'volume-de135c60-607c-47fa-8cf4-06082197a828', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ed249c-193f-4206-99b3-0ba996b7502c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ed249c-193f-4206-99b3-0ba996b7502c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd931f6-1ab3-4c9f-91db-e2de4d67db32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Volume de135c60-607c-47fa-8cf4-06082197a828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de135c60-607c-47fa-8cf4-06082197a828', 'volume_size': 1} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1600393677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de135c60-607c-47fa-8cf4-06082197a828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65aefc940128418f9efe4ed5a5de5000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:34Z,use_quota=True,user_id='29e4688e3710407db40775b50da645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Creating volume de135c60-607c-47fa-8cf4-06082197a828 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:34 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-de135c60-607c-47fa-8cf4-06082197a828 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:34 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-de135c60-607c-47fa-8cf4-06082197a828 1073741824 Jul 21 19:17:34 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Flow 'volume_create_manager' (b4629ee1-3bc4-4d12-92c6-cb5fb15bdc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d04a48d-d03b-4d28-b708-fcf94874ec51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d04a48d-d03b-4d28-b708-fcf94874ec51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2136986242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56655132-657e-4cf6-95a0-8da4b98973e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65aefc940128418f9efe4ed5a5de5000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:34Z,use_quota=True,user_id='29e4688e3710407db40775b50da645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08164fa-fb0f-46a1-9f76-3f5ddccb1831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08164fa-fb0f-46a1-9f76-3f5ddccb1831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e6ddb7-08b7-4eae-bc4f-8e7edf9e1f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e6ddb7-08b7-4eae-bc4f-8e7edf9e1f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56655132-657e-4cf6-95a0-8da4b98973e7', 'volume_name': 'volume-56655132-657e-4cf6-95a0-8da4b98973e7', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992964ff-b7a1-4886-8569-a597ad2b4d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992964ff-b7a1-4886-8569-a597ad2b4d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c066a8fa-d2d5-40d0-98ba-eeca4d6cc55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Volume 56655132-657e-4cf6-95a0-8da4b98973e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56655132-657e-4cf6-95a0-8da4b98973e7', 'volume_size': 1} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e979f82-e684-4669-805a-cca9d2493f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e31446b3-34f8-4dd7-8b79-286367a2650d', 'volume_name': 'volume-e31446b3-34f8-4dd7-8b79-286367a2650d', 'volume_size': 1, 'image_id': 'babb8f56-baa7-4bfe-a792-550de81c8ba5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babb8f56-baa7-4bfe-a792-550de81c8ba5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e919b4a53ec2ecde1119ae8ba23cfc38', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3fcdac139c514db7b26fde583c523adf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '249c9bee1902a746dfc1614638dcd2c1f0b70cb082396709514a2c36d706ca0c3a482df9c29a1bcf81475375f85293543d94296d5c14ab87e4368bb5112761aa', 'id': 'babb8f56-baa7-4bfe-a792-550de81c8ba5', 'created_at': datetime.datetime(2026, 7, 21, 17, 17, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 17, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babb8f56-baa7-4bfe-a792-550de81c8ba5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a26ac4-b415-4565-87b1-76308e8072c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a26ac4-b415-4565-87b1-76308e8072c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429eaa15-6eff-43c0-a187-da858046fc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Volume e31446b3-34f8-4dd7-8b79-286367a2650d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e31446b3-34f8-4dd7-8b79-286367a2650d', 'volume_size': 1, 'image_id': 'babb8f56-baa7-4bfe-a792-550de81c8ba5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babb8f56-baa7-4bfe-a792-550de81c8ba5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e919b4a53ec2ecde1119ae8ba23cfc38', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3fcdac139c514db7b26fde583c523adf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '249c9bee1902a746dfc1614638dcd2c1f0b70cb082396709514a2c36d706ca0c3a482df9c29a1bcf81475375f85293543d94296d5c14ab87e4368bb5112761aa', 'id': 'babb8f56-baa7-4bfe-a792-550de81c8ba5', 'created_at': datetime.datetime(2026, 7, 21, 17, 17, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 17, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babb8f56-baa7-4bfe-a792-550de81c8ba5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Trying to clone e31446b3-34f8-4dd7-8b79-286367a2650d from image babb8f56-baa7-4bfe-a792-550de81c8ba5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/babb8f56-baa7-4bfe-a792-550de81c8ba5', 'metadata': {}}]). {{(pid=87487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:17:34 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Image download 0.00 MB at 0.00 MB/s Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef371e5b-a24a-4a6d-8ae7-2932437c7dba]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Flow 'volume_create_manager' (8f600d1c-04e4-40aa-b9de-573b0958e9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d0dddd-4256-4d45-960b-7c7a67f8ff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-de135c60-607c-47fa-8cf4-06082197a828 1073741824" returned: 0 in 0.657s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d0dddd-4256-4d45-960b-7c7a67f8ff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1902689988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0518b7-46ed-492c-b8df-2824fb161d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65aefc940128418f9efe4ed5a5de5000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:35Z,use_quota=True,user_id='29e4688e3710407db40775b50da645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efa151a-63b6-4eca-8f4f-ef11acef3be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efa151a-63b6-4eca-8f4f-ef11acef3be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d27131-7595-4189-8b39-ab6a7441fe68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD Jul 21 19:17:34 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d27131-7595-4189-8b39-ab6a7441fe68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c0518b7-46ed-492c-b8df-2824fb161d84', 'volume_name': 'volume-3c0518b7-46ed-492c-b8df-2824fb161d84', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef96de6d-9077-4c6c-b457-8e49a7225026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef96de6d-9077-4c6c-b457-8e49a7225026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d24abd3-816a-47c6-bbf1-5f7324487582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:34 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Volume 3c0518b7-46ed-492c-b8df-2824fb161d84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c0518b7-46ed-492c-b8df-2824fb161d84', 'volume_size': 1} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-de135c60-607c-47fa-8cf4-06082197a828 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:34 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-de135c60-607c-47fa-8cf4-06082197a828 Jul 21 19:17:34 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:35 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:35 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Flow 'volume_create_manager' (1f504b3d-3180-4066-9d92-f9d89fb79f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f429da28-b9b0-42ed-8a80-b2ca695037f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-de135c60-607c-47fa-8cf4-06082197a828" returned: 0 in 0.339s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.898s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2136986242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56655132-657e-4cf6-95a0-8da4b98973e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65aefc940128418f9efe4ed5a5de5000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:34Z,use_quota=True,user_id='29e4688e3710407db40775b50da645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Creating volume 56655132-657e-4cf6-95a0-8da4b98973e7 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:35 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56655132-657e-4cf6-95a0-8da4b98973e7 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f429da28-b9b0-42ed-8a80-b2ca695037f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1672761520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6151c03c-09b9-4f7a-84c1-32c89bd01971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65aefc940128418f9efe4ed5a5de5000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:35Z,use_quota=True,user_id='29e4688e3710407db40775b50da645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97aedf4b-67b2-4884-b28f-76a9aa5cbcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:35 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56655132-657e-4cf6-95a0-8da4b98973e7 1073741824 Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97aedf4b-67b2-4884-b28f-76a9aa5cbcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:35 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac0d479-d3e2-420a-9d20-6519a32846b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac0d479-d3e2-420a-9d20-6519a32846b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6151c03c-09b9-4f7a-84c1-32c89bd01971', 'volume_name': 'volume-6151c03c-09b9-4f7a-84c1-32c89bd01971', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:35 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99ce64e-7fc7-4150-9e71-dc0912c133b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:35 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99ce64e-7fc7-4150-9e71-dc0912c133b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6e8467-3422-4ebd-bcd4-883fa241e7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:35 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Volume 6151c03c-09b9-4f7a-84c1-32c89bd01971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6151c03c-09b9-4f7a-84c1-32c89bd01971', 'volume_size': 1} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd931f6-1ab3-4c9f-91db-e2de4d67db32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de135c60-607c-47fa-8cf4-06082197a828', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287b7152-1acc-49f8-bde5-7278d6978ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:35 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Volume volume-de135c60-607c-47fa-8cf4-06082197a828 (de135c60-607c-47fa-8cf4-06082197a828): created successfully Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287b7152-1acc-49f8-bde5-7278d6978ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Flow 'volume_create_manager' (c3502a4c-2b6c-43d6-8dd8-a6f9315c38da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:35 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f5e3684c-541b-4230-9709-6b2dc4b32653 tempest-CreateVolumesFromImageTest-140142304 None] Created volume successfully. Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Flow 'volume_create_manager' (1650cfcb-d2c1-4603-b8b7-c0f47e8013ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca54c62c-0aa7-48d5-934a-e60a140112d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:35 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD" returned: 1 in 0.495s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Temporary image babb8f56-baa7-4bfe-a792-550de81c8ba5 is fetched for user 666c2328926f4934af45709b4df7e9cc. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca54c62c-0aa7-48d5-934a-e60a140112d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1598166417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac9e6ca-193d-4498-a6b8-4440aca66707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65aefc940128418f9efe4ed5a5de5000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:35Z,use_quota=True,user_id='29e4688e3710407db40775b50da645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b43393-c029-48c1-b8ce-372c938c81e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b43393-c029-48c1-b8ce-372c938c81e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d121cabf-51d6-49eb-857d-af1ecba14037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d121cabf-51d6-49eb-857d-af1ecba14037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac9e6ca-193d-4498-a6b8-4440aca66707', 'volume_name': 'volume-eac9e6ca-193d-4498-a6b8-4440aca66707', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3b2502-31f2-4986-a9a9-e57152de6ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3b2502-31f2-4986-a9a9-e57152de6ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41bb40b-53be-48a6-8530-b8fe3f8130d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:35 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Volume eac9e6ca-193d-4498-a6b8-4440aca66707: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac9e6ca-193d-4498-a6b8-4440aca66707', 'volume_size': 1} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f0905e-6bd1-4a8e-a65e-8ca3934cbd24]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:35 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56655132-657e-4cf6-95a0-8da4b98973e7 1073741824" returned: 0 in 0.612s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:35 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD Jul 21 19:17:35 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56655132-657e-4cf6-95a0-8da4b98973e7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:35 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56655132-657e-4cf6-95a0-8da4b98973e7 Jul 21 19:17:35 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:36 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:36 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56655132-657e-4cf6-95a0-8da4b98973e7" returned: 0 in 0.261s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.312s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1902689988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0518b7-46ed-492c-b8df-2824fb161d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65aefc940128418f9efe4ed5a5de5000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:35Z,use_quota=True,user_id='29e4688e3710407db40775b50da645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Creating volume 3c0518b7-46ed-492c-b8df-2824fb161d84 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:36 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c0518b7-46ed-492c-b8df-2824fb161d84 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c066a8fa-d2d5-40d0-98ba-eeca4d6cc55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56655132-657e-4cf6-95a0-8da4b98973e7', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:36 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c0518b7-46ed-492c-b8df-2824fb161d84 1073741824 Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d91e62-ddb2-4d4b-9122-3652c42bfe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:36 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:36 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Volume volume-56655132-657e-4cf6-95a0-8da4b98973e7 (56655132-657e-4cf6-95a0-8da4b98973e7): created successfully Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d91e62-ddb2-4d4b-9122-3652c42bfe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Flow 'volume_create_manager' (b4629ee1-3bc4-4d12-92c6-cb5fb15bdc57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:36 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5a0d3ad2-3502-4e3c-be70-95275dbf95a4 tempest-CreateVolumesFromImageTest-140142304 None] Created volume successfully. Jul 21 19:17:36 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD Jul 21 19:17:36 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:36 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:36 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c0518b7-46ed-492c-b8df-2824fb161d84 1073741824" returned: 0 in 0.467s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c0518b7-46ed-492c-b8df-2824fb161d84 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:36 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c0518b7-46ed-492c-b8df-2824fb161d84 Jul 21 19:17:36 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:36 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c0518b7-46ed-492c-b8df-2824fb161d84" returned: 0 in 0.249s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.615s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1672761520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6151c03c-09b9-4f7a-84c1-32c89bd01971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65aefc940128418f9efe4ed5a5de5000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:35Z,use_quota=True,user_id='29e4688e3710407db40775b50da645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Creating volume 6151c03c-09b9-4f7a-84c1-32c89bd01971 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:36 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6151c03c-09b9-4f7a-84c1-32c89bd01971 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d24abd3-816a-47c6-bbf1-5f7324487582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c0518b7-46ed-492c-b8df-2824fb161d84', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:36 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6151c03c-09b9-4f7a-84c1-32c89bd01971 1073741824 Jul 21 19:17:36 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bab4271-a1ee-4445-af94-275a88fecf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:36 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Volume volume-3c0518b7-46ed-492c-b8df-2824fb161d84 (3c0518b7-46ed-492c-b8df-2824fb161d84): created successfully Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bab4271-a1ee-4445-af94-275a88fecf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Flow 'volume_create_manager' (8f600d1c-04e4-40aa-b9de-573b0958e9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:36 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-551d005b-742b-4256-80d0-fdd2bfe2837e tempest-CreateVolumesFromImageTest-140142304 None] Created volume successfully. Jul 21 19:17:37 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6151c03c-09b9-4f7a-84c1-32c89bd01971 1073741824" returned: 0 in 0.399s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6151c03c-09b9-4f7a-84c1-32c89bd01971 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:37 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6151c03c-09b9-4f7a-84c1-32c89bd01971 Jul 21 19:17:37 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:37 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6151c03c-09b9-4f7a-84c1-32c89bd01971" returned: 0 in 0.263s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.937s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1598166417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac9e6ca-193d-4498-a6b8-4440aca66707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65aefc940128418f9efe4ed5a5de5000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:35Z,use_quota=True,user_id='29e4688e3710407db40775b50da645cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Creating volume eac9e6ca-193d-4498-a6b8-4440aca66707 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:37 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-eac9e6ca-193d-4498-a6b8-4440aca66707 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:37 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-eac9e6ca-193d-4498-a6b8-4440aca66707 1073741824 Jul 21 19:17:37 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6e8467-3422-4ebd-bcd4-883fa241e7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6151c03c-09b9-4f7a-84c1-32c89bd01971', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beccb215-e757-4c71-b8c9-a7b81b80c570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:37 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Volume volume-6151c03c-09b9-4f7a-84c1-32c89bd01971 (6151c03c-09b9-4f7a-84c1-32c89bd01971): created successfully Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beccb215-e757-4c71-b8c9-a7b81b80c570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Flow 'volume_create_manager' (1f504b3d-3180-4066-9d92-f9d89fb79f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:37 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f2b8de22-db5c-4e85-8875-4f6962b5464c tempest-CreateVolumesFromImageTest-140142304 None] Created volume successfully. Jul 21 19:17:38 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-eac9e6ca-193d-4498-a6b8-4440aca66707 1073741824" returned: 0 in 0.441s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-eac9e6ca-193d-4498-a6b8-4440aca66707 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:38 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-eac9e6ca-193d-4498-a6b8-4440aca66707 Jul 21 19:17:38 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:38 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-eac9e6ca-193d-4498-a6b8-4440aca66707" returned: 0 in 0.228s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.841s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31446b3-34f8-4dd7-8b79-286367a2650d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fcdac139c514db7b26fde583c523adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:34Z,use_quota=True,user_id='666c2328926f4934af45709b4df7e9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2897341-f88b-4d5a-9899-0c19bb6abe20),volume_type_id=d2897341-f88b-4d5a-9899-0c19bb6abe20)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Creating volume e31446b3-34f8-4dd7-8b79-286367a2650d {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:38 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41bb40b-53be-48a6-8530-b8fe3f8130d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac9e6ca-193d-4498-a6b8-4440aca66707', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:38 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d 1073741824 Jul 21 19:17:38 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21ba63b-05d5-4ba1-87c5-3e68141898f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:38 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Volume volume-eac9e6ca-193d-4498-a6b8-4440aca66707 (eac9e6ca-193d-4498-a6b8-4440aca66707): created successfully Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21ba63b-05d5-4ba1-87c5-3e68141898f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Flow 'volume_create_manager' (1650cfcb-d2c1-4603-b8b7-c0f47e8013ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:38 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-75f2c36f-9fa5-414d-ab72-eaae39d5c8a4 tempest-CreateVolumesFromImageTest-140142304 None] Created volume successfully. Jul 21 19:17:38 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d 1073741824" returned: 0 in 0.446s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:38 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d Jul 21 19:17:38 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "cinder-eac9e6ca-193d-4498-a6b8-4440aca66707-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-eac9e6ca-193d-4498-a6b8-4440aca66707-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "cinder-quobyte-eac9e6ca-193d-4498-a6b8-4440aca66707" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-quobyte-eac9e6ca-193d-4498-a6b8-4440aca66707" acquired by "delete_volume" :: waited 0.013s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d6af04-a8ef-49aa-81c3-b05909c06588]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-eac9e6ca-193d-4498-a6b8-4440aca66707 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:39 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d" returned: 0 in 0.275s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Attempting download of babb8f56-baa7-4bfe-a792-550de81c8ba5 ((None, [{'url': 'file:///opt/stack/data/glance/images/babb8f56-baa7-4bfe-a792-550de81c8ba5', 'metadata': {}}])) to volume e31446b3-34f8-4dd7-8b79-286367a2650d. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:17:39 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-eac9e6ca-193d-4498-a6b8-4440aca66707 Jul 21 19:17:39 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e456b3-1702-4f98-bc5d-e0f83a10987f]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babb8f56-baa7-4bfe-a792-550de81c8ba5_p1isl2k7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:39 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babb8f56-baa7-4bfe-a792-550de81c8ba5_p1isl2k7 Jul 21 19:17:39 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:39 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-eac9e6ca-193d-4498-a6b8-4440aca66707" returned: 0 in 0.352s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-eac9e6ca-193d-4498-a6b8-4440aca66707 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:39 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-eac9e6ca-193d-4498-a6b8-4440aca66707 Jul 21 19:17:39 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:39 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babb8f56-baa7-4bfe-a792-550de81c8ba5_p1isl2k7" returned: 0 in 0.334s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babb8f56-baa7-4bfe-a792-550de81c8ba5_p1isl2k7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:39 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babb8f56-baa7-4bfe-a792-550de81c8ba5_p1isl2k7 Jul 21 19:17:39 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:39 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-eac9e6ca-193d-4498-a6b8-4440aca66707" returned: 0 in 0.273s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-quobyte-eac9e6ca-193d-4498-a6b8-4440aca66707" released by "delete_volume" :: held 0.663s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Created reservations ['2bc957e7-03aa-49f6-9917-316ce2ced973', '59bb5d5a-550a-4aff-9ee5-37235893f946', 'a76428a4-92a6-4cc8-9b77-f050f9e71f6d', '090378ab-907e-4d0d-a278-133e89672b6e'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:39 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:17:39 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:39 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babb8f56-baa7-4bfe-a792-550de81c8ba5_p1isl2k7" returned: 1 in 0.341s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babb8f56-baa7-4bfe-a792-550de81c8ba5_p1isl2k7' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b5a5ac-c2c4-49c7-a653-7872b812a253]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:40 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD Jul 21 19:17:40 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:40 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.259s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:40 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Deleted volume successfully. Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7c602c23-e0d8-43d4-83e9-9f6d32a6bee7 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-eac9e6ca-193d-4498-a6b8-4440aca66707-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "cinder-6151c03c-09b9-4f7a-84c1-32c89bd01971-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-6151c03c-09b9-4f7a-84c1-32c89bd01971-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "cinder-quobyte-6151c03c-09b9-4f7a-84c1-32c89bd01971" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-quobyte-6151c03c-09b9-4f7a-84c1-32c89bd01971" acquired by "delete_volume" :: waited 0.016s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb63fb3b-ba34-4c55-a773-53fdb2295229]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6151c03c-09b9-4f7a-84c1-32c89bd01971 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:40 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:40 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6151c03c-09b9-4f7a-84c1-32c89bd01971 Jul 21 19:17:40 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:40 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD Jul 21 19:17:40 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:40 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] babb8f56-baa7-4bfe-a792-550de81c8ba5 was raw, converting to qcow2 {{(pid=87487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:40 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:40 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d Jul 21 19:17:40 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6151c03c-09b9-4f7a-84c1-32c89bd01971" returned: 0 in 0.398s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6151c03c-09b9-4f7a-84c1-32c89bd01971 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:40 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:17:40 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:40 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6151c03c-09b9-4f7a-84c1-32c89bd01971 Jul 21 19:17:40 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:40 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.245s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:17:40 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6151c03c-09b9-4f7a-84c1-32c89bd01971" returned: 0 in 0.271s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-quobyte-6151c03c-09b9-4f7a-84c1-32c89bd01971" released by "delete_volume" :: held 0.717s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Created reservations ['f5c01931-e34b-456d-afe3-9a161ec0e820', 'a58c5c31-d9b2-4769-a69d-1a374d1cb002', '3546f5aa-ec98-40d4-b750-6287c669cae1', '475bfd7c-54e0-4987-9297-ec3f84c88c2b'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:41 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:17:41 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:41 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d" returned: 0 in 0.486s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_babb8f56-baa7-4bfe-a792-550de81c8ba5_unyrvslydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:17:41 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:41 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d 1G Jul 21 19:17:41 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "cinder-3c0518b7-46ed-492c-b8df-2824fb161d84-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:41 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.256s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:41 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Deleted volume successfully. Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-3c0518b7-46ed-492c-b8df-2824fb161d84-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c8a9197c-ac85-4129-813e-a1526f240273 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-6151c03c-09b9-4f7a-84c1-32c89bd01971-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "cinder-quobyte-3c0518b7-46ed-492c-b8df-2824fb161d84" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-quobyte-3c0518b7-46ed-492c-b8df-2824fb161d84" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:41 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d 1G" returned: 0 in 0.335s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Downloaded image babb8f56-baa7-4bfe-a792-550de81c8ba5 ((None, [{'url': 'file:///opt/stack/data/glance/images/babb8f56-baa7-4bfe-a792-550de81c8ba5', 'metadata': {}}])) to volume e31446b3-34f8-4dd7-8b79-286367a2650d successfully. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Temporary image babb8f56-baa7-4bfe-a792-550de81c8ba5 for user 666c2328926f4934af45709b4df7e9cc is deleted. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Marking volume e31446b3-34f8-4dd7-8b79-286367a2650d as bootable. {{(pid=87487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1b1313-4db4-4dc3-90dd-7411bab89910]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c0518b7-46ed-492c-b8df-2824fb161d84 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Copying metadata from image babb8f56-baa7-4bfe-a792-550de81c8ba5 to e31446b3-34f8-4dd7-8b79-286367a2650d. {{(pid=87487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Creating volume glance metadata for volume e31446b3-34f8-4dd7-8b79-286367a2650d backed by image babb8f56-baa7-4bfe-a792-550de81c8ba5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'babb8f56-baa7-4bfe-a792-550de81c8ba5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e919b4a53ec2ecde1119ae8ba23cfc38', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429eaa15-6eff-43c0-a187-da858046fc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31446b3-34f8-4dd7-8b79-286367a2650d', 'volume_size': 1, 'image_id': 'babb8f56-baa7-4bfe-a792-550de81c8ba5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babb8f56-baa7-4bfe-a792-550de81c8ba5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e919b4a53ec2ecde1119ae8ba23cfc38', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3fcdac139c514db7b26fde583c523adf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '249c9bee1902a746dfc1614638dcd2c1f0b70cb082396709514a2c36d706ca0c3a482df9c29a1bcf81475375f85293543d94296d5c14ab87e4368bb5112761aa', 'id': 'babb8f56-baa7-4bfe-a792-550de81c8ba5', 'created_at': datetime.datetime(2026, 7, 21, 17, 17, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 17, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babb8f56-baa7-4bfe-a792-550de81c8ba5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a2b8dc-e573-4179-9784-6ac0c6f999a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:41 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Volume volume-e31446b3-34f8-4dd7-8b79-286367a2650d (e31446b3-34f8-4dd7-8b79-286367a2650d): created successfully Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a2b8dc-e573-4179-9784-6ac0c6f999a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:41 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c0518b7-46ed-492c-b8df-2824fb161d84 Jul 21 19:17:41 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Flow 'volume_create_manager' (d662c8b4-1797-407d-a62c-d0108d2ebf33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:41 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-8c5e1e82-973b-4ab9-a159-36a385d2efbd tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Created volume successfully. Jul 21 19:17:41 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c0518b7-46ed-492c-b8df-2824fb161d84" returned: 0 in 0.357s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c0518b7-46ed-492c-b8df-2824fb161d84 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:41 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c0518b7-46ed-492c-b8df-2824fb161d84 Jul 21 19:17:41 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:42 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c0518b7-46ed-492c-b8df-2824fb161d84" returned: 0 in 0.240s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-quobyte-3c0518b7-46ed-492c-b8df-2824fb161d84" released by "delete_volume" :: held 0.638s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Created reservations ['7bee0792-e7aa-4049-95dd-60090b6a54c5', 'feacf605-680d-44a1-b471-dbaca2965e3d', '69aa6a3d-c36d-4f7b-b878-9031fc78e5f5', '8c44273c-125c-486b-96ac-3157286dc02f'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:42 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:17:42 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Acquiring lock "cinder-e31446b3-34f8-4dd7-8b79-286367a2650d-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Lock "cinder-e31446b3-34f8-4dd7-8b79-286367a2650d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Acquiring lock "cinder-quobyte-e31446b3-34f8-4dd7-8b79-286367a2650d" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Lock "cinder-quobyte-e31446b3-34f8-4dd7-8b79-286367a2650d" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a410ca6b-8155-446c-ae9c-fb235cf831f6]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:42 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d Jul 21 19:17:42 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:42 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.271s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:42 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Deleted volume successfully. Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "cinder-56655132-657e-4cf6-95a0-8da4b98973e7-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-be9616a1-ca96-42ed-9c45-a8f1221dbd6a tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-3c0518b7-46ed-492c-b8df-2824fb161d84-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-56655132-657e-4cf6-95a0-8da4b98973e7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "cinder-quobyte-56655132-657e-4cf6-95a0-8da4b98973e7" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-quobyte-56655132-657e-4cf6-95a0-8da4b98973e7" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3363708-73a7-44de-8a7a-83bd7fc287f3]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56655132-657e-4cf6-95a0-8da4b98973e7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:42 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56655132-657e-4cf6-95a0-8da4b98973e7 Jul 21 19:17:42 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:42 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d" returned: 0 in 0.405s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:42 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d Jul 21 19:17:42 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:42 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56655132-657e-4cf6-95a0-8da4b98973e7" returned: 0 in 0.368s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56655132-657e-4cf6-95a0-8da4b98973e7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:43 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e31446b3-34f8-4dd7-8b79-286367a2650d" returned: 0 in 0.250s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:43 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56655132-657e-4cf6-95a0-8da4b98973e7 Jul 21 19:17:43 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Lock "cinder-quobyte-e31446b3-34f8-4dd7-8b79-286367a2650d" released by "delete_volume" :: held 0.700s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:43 devstack cinder-volume[87487]: WARNING cinder.quota [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:17:43 devstack cinder-volume[87487]: WARNING cinder.quota [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Created reservations ['b701b37d-1512-4bd1-a4de-7f08c7512367', '91e31f36-d56a-4d30-9804-9f9dd371a0bd', '88ea0bc4-c966-4760-b2aa-da0d50afc859', 'b6fdc85c-eeca-4e50-9380-c57adbd185e2'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:43 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:17:43 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:43 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56655132-657e-4cf6-95a0-8da4b98973e7" returned: 0 in 0.259s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-quobyte-56655132-657e-4cf6-95a0-8da4b98973e7" released by "delete_volume" :: held 0.671s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Created reservations ['870fc7a7-357d-4c48-84bd-b7ed60b36a0d', '3c5ca394-44b4-4a6e-b845-10568637e0d0', '2b2f7654-f29b-4d9b-b31c-d59e9001c8ce', '631cd268-df48-48c3-9695-18c24870449b'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:43 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.280s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:43 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Deleted volume successfully. Jul 21 19:17:43 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:17:43 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-05094ef2-0842-4e3f-b143-f798d4b65c7d tempest-VolumeAndVolumeTypeFromImageTest-979363572 None] Lock "cinder-e31446b3-34f8-4dd7-8b79-286367a2650d-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "cinder-de135c60-607c-47fa-8cf4-06082197a828-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-de135c60-607c-47fa-8cf4-06082197a828-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:43 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.330s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:43 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Deleted volume successfully. Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "cinder-quobyte-de135c60-607c-47fa-8cf4-06082197a828" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-4d9dc1d6-3077-435e-91ea-fb17f2316b59 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-56655132-657e-4cf6-95a0-8da4b98973e7-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-quobyte-de135c60-607c-47fa-8cf4-06082197a828" acquired by "delete_volume" :: waited 0.016s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecc5abb-6d7f-4433-8482-e2c937832394]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-de135c60-607c-47fa-8cf4-06082197a828 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:43 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-de135c60-607c-47fa-8cf4-06082197a828 Jul 21 19:17:43 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:44 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-de135c60-607c-47fa-8cf4-06082197a828" returned: 0 in 0.373s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-de135c60-607c-47fa-8cf4-06082197a828 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:44 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-de135c60-607c-47fa-8cf4-06082197a828 Jul 21 19:17:44 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:44 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-de135c60-607c-47fa-8cf4-06082197a828" returned: 0 in 0.252s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-quobyte-de135c60-607c-47fa-8cf4-06082197a828" released by "delete_volume" :: held 0.673s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:44 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Created reservations ['5f6e73c0-ff88-4194-8484-37ab772ed638', '07b27818-3ec7-4acb-9abb-3393484d312a', '49d788a2-8e4e-44d3-8f0d-685ead413f3d', '307fc1e7-6a4a-41c7-bc85-e5e615bdb1fe'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:44 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:17:44 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:44 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.276s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:44 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:44 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Deleted volume successfully. Jul 21 19:17:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b841ff08-be15-4f1c-a32d-f7b7df13fb93 tempest-CreateVolumesFromImageTest-140142304 None] Lock "cinder-de135c60-607c-47fa-8cf4-06082197a828-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=132,cinder:INSERT=57,cinder:UPDATE=177,cinder:DELETE=13 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Flow 'volume_create_manager' (4508a9b4-5e8e-4280-92fc-0ed1e6c3fb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f20102-09b5-4742-a164-22cd94973cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f20102-09b5-4742-a164-22cd94973cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960c14d8-12d2-4216-b5d5-e1102edc12e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a066d1657d845ae8bd45de5b5f4181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:48Z,use_quota=True,user_id='2a417570110145e28846ee46accbbed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549bcd2b-eac1-4121-87e1-e1cb70ac2872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549bcd2b-eac1-4121-87e1-e1cb70ac2872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b689cd-afa4-48c4-84d8-f5c4a9552f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b689cd-afa4-48c4-84d8-f5c4a9552f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '960c14d8-12d2-4216-b5d5-e1102edc12e4', 'volume_name': 'volume-960c14d8-12d2-4216-b5d5-e1102edc12e4', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1663932-e273-4968-a66c-773435d79843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1663932-e273-4968-a66c-773435d79843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9eb073-dd54-495a-ad7f-aaff52dac9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:48 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Volume 960c14d8-12d2-4216-b5d5-e1102edc12e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-960c14d8-12d2-4216-b5d5-e1102edc12e4', 'volume_size': 1} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960c14d8-12d2-4216-b5d5-e1102edc12e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a066d1657d845ae8bd45de5b5f4181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:48Z,use_quota=True,user_id='2a417570110145e28846ee46accbbed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Creating volume 960c14d8-12d2-4216-b5d5-e1102edc12e4 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:48 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-960c14d8-12d2-4216-b5d5-e1102edc12e4 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:48 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-960c14d8-12d2-4216-b5d5-e1102edc12e4 1073741824 Jul 21 19:17:48 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Flow 'volume_create_manager' (c290d534-c949-4f03-b238-60a0f9bb33fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121ab1d5-9253-4ae5-b82c-1111faf9cbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121ab1d5-9253-4ae5-b82c-1111faf9cbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1184246428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3b4f86-8ab2-43d6-a117-8501bce97f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be2e4ee0fb4093a275a72ab518de94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:48Z,use_quota=True,user_id='86fe5b85213c49f98edcca7c79d6b44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a401f254-44e5-4706-a0e1-a882bb4ea452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a401f254-44e5-4706-a0e1-a882bb4ea452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e548521b-bae4-43a1-aba8-24cb60dec496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e548521b-bae4-43a1-aba8-24cb60dec496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f3b4f86-8ab2-43d6-a117-8501bce97f27', 'volume_name': 'volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60f148a-dfa2-4af1-9b30-1f7e9bcd3454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60f148a-dfa2-4af1-9b30-1f7e9bcd3454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d21ffc4-701d-4f5c-8028-44b4fadbdcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:48 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume 0f3b4f86-8ab2-43d6-a117-8501bce97f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27', 'volume_size': 1} Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:48 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-960c14d8-12d2-4216-b5d5-e1102edc12e4 1073741824" returned: 0 in 0.411s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-960c14d8-12d2-4216-b5d5-e1102edc12e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:49 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-960c14d8-12d2-4216-b5d5-e1102edc12e4 Jul 21 19:17:49 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:49 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-960c14d8-12d2-4216-b5d5-e1102edc12e4" returned: 0 in 0.239s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.576s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1184246428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3b4f86-8ab2-43d6-a117-8501bce97f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be2e4ee0fb4093a275a72ab518de94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:48Z,use_quota=True,user_id='86fe5b85213c49f98edcca7c79d6b44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Creating volume 0f3b4f86-8ab2-43d6-a117-8501bce97f27 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:49 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9eb073-dd54-495a-ad7f-aaff52dac9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-960c14d8-12d2-4216-b5d5-e1102edc12e4', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:49 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 1073741824 Jul 21 19:17:49 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85388408-fdcb-40bf-8189-915845499cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:49 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Volume volume-960c14d8-12d2-4216-b5d5-e1102edc12e4 (960c14d8-12d2-4216-b5d5-e1102edc12e4): created successfully Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85388408-fdcb-40bf-8189-915845499cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Flow 'volume_create_manager' (4508a9b4-5e8e-4280-92fc-0ed1e6c3fb35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:49 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b9fe99a0-a5ae-4fb2-9f0a-33b9a994402f tempest-CinderUnicodeTest-381923319 None] Created volume successfully. Jul 21 19:17:49 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 1073741824" returned: 0 in 0.433s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:49 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 Jul 21 19:17:49 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:50 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27" returned: 0 in 0.256s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d21ffc4-701d-4f5c-8028-44b4fadbdcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdacf838-5897-4f1c-bec5-0de6aff5b49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:50 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 (0f3b4f86-8ab2-43d6-a117-8501bce97f27): created successfully Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdacf838-5897-4f1c-bec5-0de6aff5b49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Flow 'volume_create_manager' (c290d534-c949-4f03-b238-60a0f9bb33fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:50 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d153b011-8631-4d4b-867a-41ee6347d1f6 tempest-CreateVolumesFromSnapshotTest-346309554 None] Created volume successfully. Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] Creating offline snapshot df202e99-f8ad-4e8e-b989-f746f137a109 of volume 0f3b4f86-8ab2-43d6-a117-8501bce97f27 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[289550bb-75b5-4f31-a021-1f22199206d6]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:50 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 Jul 21 19:17:50 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Flow 'volume_create_manager' (48c3f5da-30e2-4462-9859-729ec51d5d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21abf5c7-23a6-4db1-b0da-27ccb2d8c563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21abf5c7-23a6-4db1-b0da-27ccb2d8c563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1372970767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b3b925-37e7-463a-972d-a4ac309b6e0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a066d1657d845ae8bd45de5b5f4181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:51Z,use_quota=True,user_id='2a417570110145e28846ee46accbbed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5b7287-0709-49dc-8513-54b93c4079d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5b7287-0709-49dc-8513-54b93c4079d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29453043-465d-480d-b5c3-1bf69b1ceaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29453043-465d-480d-b5c3-1bf69b1ceaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3b3b925-37e7-463a-972d-a4ac309b6e0c', 'volume_name': 'volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7ee0f7-ba22-4441-88bc-95f9e7387dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7ee0f7-ba22-4441-88bc-95f9e7387dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28879ac6-f6d2-4abe-87b0-074b0c45bd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:50 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Volume c3b3b925-37e7-463a-972d-a4ac309b6e0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c', 'volume_size': 1} Jul 21 19:17:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:51 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27" returned: 0 in 0.396s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:51 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 1G Jul 21 19:17:51 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:51 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 1G" returned: 0 in 0.388s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:51 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 Jul 21 19:17:51 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:51 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109" returned: 0 in 0.318s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:51 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 is being set with open permissions: ugo+rw Jul 21 19:17:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:51 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 Jul 21 19:17:51 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:52 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109" returned: 0 in 0.257s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:52 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.info Jul 21 19:17:52 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:52 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.info" returned: 0 in 0.235s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:52 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.info is being set with open permissions: ugo+rw Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:52 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.info Jul 21 19:17:52 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:52 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.info" returned: 0 in 0.223s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.535s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1372970767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b3b925-37e7-463a-972d-a4ac309b6e0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a066d1657d845ae8bd45de5b5f4181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:51Z,use_quota=True,user_id='2a417570110145e28846ee46accbbed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Creating volume c3b3b925-37e7-463a-972d-a4ac309b6e0c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:52 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:52 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c 1073741824 Jul 21 19:17:52 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:52 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d92b764b-0e71-4954-b3e6-a2cd52e0f917 tempest-CreateVolumesFromSnapshotTest-346309554 None] Create snapshot completed successfully Jul 21 19:17:52 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c 1073741824" returned: 0 in 0.432s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:53 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c Jul 21 19:17:53 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Flow 'volume_create_manager' (3ff78dc4-5042-4580-94cb-84452eb427fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c89270d-0c3e-43cb-bd68-4177d62c7b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c89270d-0c3e-43cb-bd68-4177d62c7b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1679480325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed526b43-f39c-463f-811b-12d0fc46d2ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be2e4ee0fb4093a275a72ab518de94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:53Z,use_quota=True,user_id='86fe5b85213c49f98edcca7c79d6b44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f67f492-0e29-476b-80c8-cf6355bdc27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f67f492-0e29-476b-80c8-cf6355bdc27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45111c8e-a587-4e02-816a-faec2f7300e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45111c8e-a587-4e02-816a-faec2f7300e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed526b43-f39c-463f-811b-12d0fc46d2ff', 'volume_name': 'volume-ed526b43-f39c-463f-811b-12d0fc46d2ff', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d401acd3-0e03-44c4-8900-7e3dadb6a968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d401acd3-0e03-44c4-8900-7e3dadb6a968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6740fea7-1102-4bc1-bd4c-df3678167a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume ed526b43-f39c-463f-811b-12d0fc46d2ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed526b43-f39c-463f-811b-12d0fc46d2ff', 'volume_size': 1} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:53 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c" returned: 0 in 0.258s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1679480325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed526b43-f39c-463f-811b-12d0fc46d2ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be2e4ee0fb4093a275a72ab518de94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:53Z,use_quota=True,user_id='86fe5b85213c49f98edcca7c79d6b44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Creating volume ed526b43-f39c-463f-811b-12d0fc46d2ff {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:53 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed526b43-f39c-463f-811b-12d0fc46d2ff 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28879ac6-f6d2-4abe-87b0-074b0c45bd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:53 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed526b43-f39c-463f-811b-12d0fc46d2ff 1073741824 Jul 21 19:17:53 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61afd96-204c-4063-93ff-5a259f7637f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Volume volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c (c3b3b925-37e7-463a-972d-a4ac309b6e0c): created successfully Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61afd96-204c-4063-93ff-5a259f7637f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Flow 'volume_create_manager' (48c3f5da-30e2-4462-9859-729ec51d5d61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:53 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-69b97dce-a07b-4a16-ade5-8c4d40c5b001 tempest-CinderUnicodeTest-381923319 None] Created volume successfully. Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Flow 'volume_create_manager' (5379ddb8-0992-4563-8087-6cde65e625e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f50554-1aad-48a3-9c64-e84e08c25cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f50554-1aad-48a3-9c64-e84e08c25cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1404125975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46943974-5cfc-496e-b262-1987616ecdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be2e4ee0fb4093a275a72ab518de94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:54Z,use_quota=True,user_id='86fe5b85213c49f98edcca7c79d6b44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (854086a2-ed42-423f-b396-72317a0ad9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (854086a2-ed42-423f-b396-72317a0ad9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ec115a-3b24-4d49-80bd-0b7b9badb917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ec115a-3b24-4d49-80bd-0b7b9badb917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46943974-5cfc-496e-b262-1987616ecdd5', 'volume_name': 'volume-46943974-5cfc-496e-b262-1987616ecdd5', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b13313a-a9ec-48cd-bef6-b1f59eb37e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b13313a-a9ec-48cd-bef6-b1f59eb37e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a0890b-641f-4d9d-b81a-531c127d0c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume 46943974-5cfc-496e-b262-1987616ecdd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46943974-5cfc-496e-b262-1987616ecdd5', 'volume_size': 1} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:53 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed526b43-f39c-463f-811b-12d0fc46d2ff 1073741824" returned: 0 in 0.610s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed526b43-f39c-463f-811b-12d0fc46d2ff {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:53 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed526b43-f39c-463f-811b-12d0fc46d2ff Jul 21 19:17:53 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Flow 'volume_create_manager' (d864ee90-42dc-4467-9ce3-32dec289f48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0d099f-0060-4476-84ee-399be68e5699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0d099f-0060-4476-84ee-399be68e5699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-957984168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fdc3ec-11e5-4a3b-baee-6d0aa286aa14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be2e4ee0fb4093a275a72ab518de94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:54Z,use_quota=True,user_id='86fe5b85213c49f98edcca7c79d6b44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e997a5-f6f3-4e12-b305-d5f295651ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e997a5-f6f3-4e12-b305-d5f295651ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0426e116-1deb-4b8f-a2b9-0c559d0f9684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0426e116-1deb-4b8f-a2b9-0c559d0f9684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54fdc3ec-11e5-4a3b-baee-6d0aa286aa14', 'volume_name': 'volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb30ba1-46e4-485c-9d62-4e00e2c2543f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb30ba1-46e4-485c-9d62-4e00e2c2543f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c55231-9b63-4b3f-ac7f-5efad54cb506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume 54fdc3ec-11e5-4a3b-baee-6d0aa286aa14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14', 'volume_size': 1} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed526b43-f39c-463f-811b-12d0fc46d2ff" returned: 0 in 0.320s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1404125975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46943974-5cfc-496e-b262-1987616ecdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be2e4ee0fb4093a275a72ab518de94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:54Z,use_quota=True,user_id='86fe5b85213c49f98edcca7c79d6b44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Creating volume 46943974-5cfc-496e-b262-1987616ecdd5 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:54 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46943974-5cfc-496e-b262-1987616ecdd5 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6740fea7-1102-4bc1-bd4c-df3678167a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed526b43-f39c-463f-811b-12d0fc46d2ff', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b9e8d7-eddc-4a7c-a0ae-7b92bf95d0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46943974-5cfc-496e-b262-1987616ecdd5 1073741824 Jul 21 19:17:54 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:54 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume volume-ed526b43-f39c-463f-811b-12d0fc46d2ff (ed526b43-f39c-463f-811b-12d0fc46d2ff): created successfully Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b9e8d7-eddc-4a7c-a0ae-7b92bf95d0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Flow 'volume_create_manager' (3ff78dc4-5042-4580-94cb-84452eb427fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:54 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4119f816-7ddb-41d4-96ed-a9c62bd494c1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Created volume successfully. Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Flow 'volume_create_manager' (8e6744b3-47d4-4bbc-9cc1-52d915d7f320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d24e264f-4860-479a-8fe6-36b2e24baae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d24e264f-4860-479a-8fe6-36b2e24baae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-468328254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef83524-2c29-4a13-8d29-e912d7ad454a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be2e4ee0fb4093a275a72ab518de94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:54Z,use_quota=True,user_id='86fe5b85213c49f98edcca7c79d6b44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0f13c8-9545-4376-9960-aa2190412533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0f13c8-9545-4376-9960-aa2190412533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b31040e-50a0-457f-a4f7-bcd1681e0b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b31040e-50a0-457f-a4f7-bcd1681e0b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bef83524-2c29-4a13-8d29-e912d7ad454a', 'volume_name': 'volume-bef83524-2c29-4a13-8d29-e912d7ad454a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5948e40-f26c-4675-837f-24ee78f2ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5948e40-f26c-4675-837f-24ee78f2ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fe4e5c-056a-431f-8c02-b25901585397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume bef83524-2c29-4a13-8d29-e912d7ad454a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bef83524-2c29-4a13-8d29-e912d7ad454a', 'volume_size': 1} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:54 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46943974-5cfc-496e-b262-1987616ecdd5 1073741824" returned: 0 in 0.548s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:UPDATE=167,cinder:INSERT=46,cinder:SELECT=132,cinder:DELETE=19 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Flow 'volume_create_manager' (b658c184-6774-470f-b592-cc67aa3952a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce118a30-de7c-445a-a383-28823a98639f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46943974-5cfc-496e-b262-1987616ecdd5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce118a30-de7c-445a-a383-28823a98639f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1753383935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df800e4d-7909-413d-8b95-f5ea20aea493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be2e4ee0fb4093a275a72ab518de94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:55Z,use_quota=True,user_id='86fe5b85213c49f98edcca7c79d6b44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46943974-5cfc-496e-b262-1987616ecdd5 Jul 21 19:17:54 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7831a684-e822-453a-b1c8-9fb4f587880f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7831a684-e822-453a-b1c8-9fb4f587880f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16dda64d-f52c-4bfb-b8c1-9545fbc00ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16dda64d-f52c-4bfb-b8c1-9545fbc00ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df800e4d-7909-413d-8b95-f5ea20aea493', 'volume_name': 'volume-df800e4d-7909-413d-8b95-f5ea20aea493', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97a62a8-d7f9-4e94-8636-b065af1e0b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97a62a8-d7f9-4e94-8636-b065af1e0b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf9d5a2-b81c-4a32-aab4-f173ea5dcaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume df800e4d-7909-413d-8b95-f5ea20aea493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df800e4d-7909-413d-8b95-f5ea20aea493', 'volume_size': 1} Jul 21 19:17:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:55 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46943974-5cfc-496e-b262-1987616ecdd5" returned: 0 in 0.242s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-957984168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fdc3ec-11e5-4a3b-baee-6d0aa286aa14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be2e4ee0fb4093a275a72ab518de94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:54Z,use_quota=True,user_id='86fe5b85213c49f98edcca7c79d6b44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Creating volume 54fdc3ec-11e5-4a3b-baee-6d0aa286aa14 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:55 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a0890b-641f-4d9d-b81a-531c127d0c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46943974-5cfc-496e-b262-1987616ecdd5', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14 1073741824 Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe66b7e0-51f7-442a-a3d9-335a73269bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:55 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume volume-46943974-5cfc-496e-b262-1987616ecdd5 (46943974-5cfc-496e-b262-1987616ecdd5): created successfully Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe66b7e0-51f7-442a-a3d9-335a73269bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Flow 'volume_create_manager' (5379ddb8-0992-4563-8087-6cde65e625e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:55 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-01c9bf8f-38ca-4868-b627-aa0a77404b31 tempest-CreateVolumesFromSnapshotTest-346309554 None] Created volume successfully. Jul 21 19:17:55 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14 1073741824" returned: 0 in 0.426s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:55 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14 Jul 21 19:17:55 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:55 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14" returned: 0 in 0.234s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.263s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-468328254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef83524-2c29-4a13-8d29-e912d7ad454a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be2e4ee0fb4093a275a72ab518de94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:54Z,use_quota=True,user_id='86fe5b85213c49f98edcca7c79d6b44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Creating volume bef83524-2c29-4a13-8d29-e912d7ad454a {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:55 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bef83524-2c29-4a13-8d29-e912d7ad454a 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c55231-9b63-4b3f-ac7f-5efad54cb506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bef83524-2c29-4a13-8d29-e912d7ad454a 1073741824 Jul 21 19:17:55 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1722edd-47c3-46e3-af8a-52c89c025988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14 (54fdc3ec-11e5-4a3b-baee-6d0aa286aa14): created successfully Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1722edd-47c3-46e3-af8a-52c89c025988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Flow 'volume_create_manager' (d864ee90-42dc-4467-9ce3-32dec289f48b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:55 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4c6d1086-019b-4e5f-845b-1ea111ca1a70 tempest-CreateVolumesFromSnapshotTest-346309554 None] Created volume successfully. Jul 21 19:17:56 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bef83524-2c29-4a13-8d29-e912d7ad454a 1073741824" returned: 0 in 0.422s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bef83524-2c29-4a13-8d29-e912d7ad454a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:56 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bef83524-2c29-4a13-8d29-e912d7ad454a Jul 21 19:17:56 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:56 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bef83524-2c29-4a13-8d29-e912d7ad454a" returned: 0 in 0.252s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.963s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fe4e5c-056a-431f-8c02-b25901585397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef83524-2c29-4a13-8d29-e912d7ad454a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a40179b-fd4d-4e13-aa70-307d25b4fcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] Creating offline snapshot d113d9a3-2106-43e9-87b0-0a073e360961 of volume c3b3b925-37e7-463a-972d-a4ac309b6e0c {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6114f1-b679-4ce1-a1ae-1e1b26ae6d64]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:56 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume volume-bef83524-2c29-4a13-8d29-e912d7ad454a (bef83524-2c29-4a13-8d29-e912d7ad454a): created successfully Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a40179b-fd4d-4e13-aa70-307d25b4fcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Flow 'volume_create_manager' (8e6744b3-47d4-4bbc-9cc1-52d915d7f320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:56 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4b7cac8d-95a9-415e-882a-e7c48fc9207f tempest-CreateVolumesFromSnapshotTest-346309554 None] Created volume successfully. Jul 21 19:17:56 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c Jul 21 19:17:56 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:56 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c" returned: 0 in 0.360s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:57 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 1G Jul 21 19:17:57 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:57 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 1G" returned: 0 in 0.386s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:57 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 Jul 21 19:17:57 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:57 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961" returned: 0 in 0.283s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:57 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 is being set with open permissions: ugo+rw Jul 21 19:17:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:57 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 Jul 21 19:17:57 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:57 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961" returned: 0 in 0.239s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:57 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.info Jul 21 19:17:57 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:58 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.info" returned: 0 in 0.245s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:58 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.info is being set with open permissions: ugo+rw Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:58 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.info Jul 21 19:17:58 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:58 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.info" returned: 0 in 0.242s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.871s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.485s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1753383935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df800e4d-7909-413d-8b95-f5ea20aea493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be2e4ee0fb4093a275a72ab518de94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:55Z,use_quota=True,user_id='86fe5b85213c49f98edcca7c79d6b44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Creating volume df800e4d-7909-413d-8b95-f5ea20aea493 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:58 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-df800e4d-7909-413d-8b95-f5ea20aea493 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:58 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-df800e4d-7909-413d-8b95-f5ea20aea493 1073741824 Jul 21 19:17:58 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:58 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5d5e5276-79a6-41ba-ba6d-829f1d97a62b tempest-CinderUnicodeTest-381923319 None] Create snapshot completed successfully Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Acquiring lock "cinder-d113d9a3-2106-43e9-87b0-0a073e360961-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Lock "cinder-d113d9a3-2106-43e9-87b0-0a073e360961-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Acquiring lock "cinder-quobyte-c3b3b925-37e7-463a-972d-a4ac309b6e0c" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Lock "cinder-quobyte-c3b3b925-37e7-463a-972d-a4ac309b6e0c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Acquiring lock "cinder-quobyte-d113d9a3-2106-43e9-87b0-0a073e360961" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Lock "cinder-quobyte-d113d9a3-2106-43e9-87b0-0a073e360961" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Deleting offline snapshot d113d9a3-2106-43e9-87b0-0a073e360961 of volume c3b3b925-37e7-463a-972d-a4ac309b6e0c {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] snapshot_file for this snap is: volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cea97a7-dda1-46da-b6ce-804d664a8ca4]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:58 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-df800e4d-7909-413d-8b95-f5ea20aea493 1073741824" returned: 0 in 0.482s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:58 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 Jul 21 19:17:58 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-df800e4d-7909-413d-8b95-f5ea20aea493 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:58 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-df800e4d-7909-413d-8b95-f5ea20aea493 Jul 21 19:17:58 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:59 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-df800e4d-7909-413d-8b95-f5ea20aea493" returned: 0 in 0.253s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:59 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961" returned: 0 in 0.399s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf9d5a2-b81c-4a32-aab4-f173ea5dcaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df800e4d-7909-413d-8b95-f5ea20aea493', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628626f7-c1fd-4aca-9567-61115ee1a87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fc2b3d-2c76-45a1-9082-1fb1f75d3957]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:59 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Volume volume-df800e4d-7909-413d-8b95-f5ea20aea493 (df800e4d-7909-413d-8b95-f5ea20aea493): created successfully Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628626f7-c1fd-4aca-9567-61115ee1a87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Flow 'volume_create_manager' (b658c184-6774-470f-b592-cc67aa3952a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:59 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a1714e7b-78ba-4981-9414-7fe71f178ac1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Created volume successfully. Jul 21 19:17:59 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c Jul 21 19:17:59 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:59 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c" returned: 0 in 0.352s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:59 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 Jul 21 19:17:59 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:59 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961" returned: 0 in 0.332s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:59 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961 Jul 21 19:17:59 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:00 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c.d113d9a3-2106-43e9-87b0-0a073e360961" returned: 0 in 0.237s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Lock "cinder-quobyte-d113d9a3-2106-43e9-87b0-0a073e360961" released by "_delete_snapshot" :: held 1.441s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Lock "cinder-quobyte-c3b3b925-37e7-463a-972d-a4ac309b6e0c" released by "delete_snapshot" :: held 1.471s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Created reservations ['9c46d29e-85a3-4d55-860a-88f67898919e', 'e1668212-3a05-4fcc-97e8-76cc2d98825f', 'ee03b8ac-c677-4c63-bab1-c460288f973d', '4173444b-86d4-4741-947f-574a9922eceb'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-df800e4d-7909-413d-8b95-f5ea20aea493-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:00 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Delete snapshot completed successfully. Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-df800e4d-7909-413d-8b95-f5ea20aea493-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-06ca0725-5ef5-4d34-81b5-80beb2702501 tempest-CinderUnicodeTest-381923319 None] Lock "cinder-d113d9a3-2106-43e9-87b0-0a073e360961-delete_snapshot" released by "delete_snapshot" :: held 1.639s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-quobyte-df800e4d-7909-413d-8b95-f5ea20aea493" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-df800e4d-7909-413d-8b95-f5ea20aea493" acquired by "delete_volume" :: waited 0.014s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e3d39e-554d-4844-b7d0-04e80e107514]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-df800e4d-7909-413d-8b95-f5ea20aea493 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:00 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-df800e4d-7909-413d-8b95-f5ea20aea493 Jul 21 19:18:00 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:00 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-df800e4d-7909-413d-8b95-f5ea20aea493" returned: 0 in 0.384s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-df800e4d-7909-413d-8b95-f5ea20aea493 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:00 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-df800e4d-7909-413d-8b95-f5ea20aea493 Jul 21 19:18:00 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Acquiring lock "cinder-c3b3b925-37e7-463a-972d-a4ac309b6e0c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Lock "cinder-c3b3b925-37e7-463a-972d-a4ac309b6e0c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Acquiring lock "cinder-quobyte-c3b3b925-37e7-463a-972d-a4ac309b6e0c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Lock "cinder-quobyte-c3b3b925-37e7-463a-972d-a4ac309b6e0c" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e2b92e-e926-4ba0-bc61-8124f5e9713c]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:01 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-df800e4d-7909-413d-8b95-f5ea20aea493" returned: 0 in 0.286s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-df800e4d-7909-413d-8b95-f5ea20aea493" released by "delete_volume" :: held 0.710s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:01 devstack sudo[103994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c Jul 21 19:18:01 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Created reservations ['907a5525-10e8-4f61-9091-0ff1294b6b5c', '000af339-6a03-4cc2-8bad-55fa3d7ff6cc', '4af465e9-36cd-4907-bcac-4fc63f5a4522', '5b587912-b86f-4a33-b299-34ac0f4c2eb5'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:01 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:01 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:01 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c" returned: 0 in 0.366s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:01 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c Jul 21 19:18:01 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:01 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-bef83524-2c29-4a13-8d29-e912d7ad454a-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.281s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:01 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Deleted volume successfully. Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-bef83524-2c29-4a13-8d29-e912d7ad454a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-48bc57ed-df5f-4aa0-88c5-31e3c8c0b5c8 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-df800e4d-7909-413d-8b95-f5ea20aea493-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-quobyte-bef83524-2c29-4a13-8d29-e912d7ad454a" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-bef83524-2c29-4a13-8d29-e912d7ad454a" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[5052fca8-6178-41ac-ac9c-2da714c04123]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bef83524-2c29-4a13-8d29-e912d7ad454a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:01 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c3b3b925-37e7-463a-972d-a4ac309b6e0c" returned: 0 in 0.303s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Lock "cinder-quobyte-c3b3b925-37e7-463a-972d-a4ac309b6e0c" released by "delete_volume" :: held 0.737s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:01 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bef83524-2c29-4a13-8d29-e912d7ad454a Jul 21 19:18:01 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Created reservations ['d4d1c839-d6f5-4d5f-9ac9-5c81405ebfc4', 'b8ff37e0-20cd-4096-b272-2c2aacd98aec', '5e886d07-7da3-4f11-a04d-1cb8c17f04cc', 'deaea9ce-1e0a-4ecb-ad26-b9dad409643c'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:01 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:01 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:02 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bef83524-2c29-4a13-8d29-e912d7ad454a" returned: 0 in 0.368s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bef83524-2c29-4a13-8d29-e912d7ad454a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:02 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bef83524-2c29-4a13-8d29-e912d7ad454a Jul 21 19:18:02 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Acquiring lock "cinder-960c14d8-12d2-4216-b5d5-e1102edc12e4-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Lock "cinder-960c14d8-12d2-4216-b5d5-e1102edc12e4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:02 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.292s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:02 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Deleted volume successfully. Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Acquiring lock "cinder-quobyte-960c14d8-12d2-4216-b5d5-e1102edc12e4" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Lock "cinder-quobyte-960c14d8-12d2-4216-b5d5-e1102edc12e4" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ca81eb08-4bec-4607-bb93-1107e77c3bdd tempest-CinderUnicodeTest-381923319 None] Lock "cinder-c3b3b925-37e7-463a-972d-a4ac309b6e0c-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c91efe-0f44-4cda-8764-040da4ac065d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-960c14d8-12d2-4216-b5d5-e1102edc12e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:02 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-960c14d8-12d2-4216-b5d5-e1102edc12e4 Jul 21 19:18:02 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:02 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-bef83524-2c29-4a13-8d29-e912d7ad454a" returned: 0 in 0.315s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-bef83524-2c29-4a13-8d29-e912d7ad454a" released by "delete_volume" :: held 0.720s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Created reservations ['03a321a8-af14-43b6-b647-96e2bbc8dcf9', '283ed8be-ce39-4595-be20-e4c505bc2044', '8b04d594-52f8-4429-abdf-248405b8d3b9', '0204589c-36e5-4fcc-b0e8-61bf118b7f70'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:02 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:02 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:02 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-960c14d8-12d2-4216-b5d5-e1102edc12e4" returned: 0 in 0.371s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-960c14d8-12d2-4216-b5d5-e1102edc12e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:02 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-960c14d8-12d2-4216-b5d5-e1102edc12e4 Jul 21 19:18:02 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:02 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.258s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:02 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Deleted volume successfully. Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c0fa2c3f-bea5-47df-a51b-8551ab5b737e tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-bef83524-2c29-4a13-8d29-e912d7ad454a-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-quobyte-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14" acquired by "delete_volume" :: waited 0.016s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6d5670-f66d-449e-a6d9-2d79b74af711]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:02 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-960c14d8-12d2-4216-b5d5-e1102edc12e4" returned: 0 in 0.293s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Lock "cinder-quobyte-960c14d8-12d2-4216-b5d5-e1102edc12e4" released by "delete_volume" :: held 0.705s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:02 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Created reservations ['f48ff301-3f03-4f45-83e3-ae16b0e9d9ef', '3b162e25-766c-4fb5-8d8a-d68dcd2818bc', '332611f8-9d03-405e-b13e-8ff4b87b9c40', '973208a2-c902-4964-aa32-787484c98e5c'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:02 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14 Jul 21 19:18:02 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:03 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:03 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:03 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14" returned: 0 in 0.371s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:03 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14 Jul 21 19:18:03 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:03 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.260s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:03 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Deleted volume successfully. Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cbf7c28a-d273-47d8-a581-c846280c2a5c tempest-CinderUnicodeTest-381923319 None] Lock "cinder-960c14d8-12d2-4216-b5d5-e1102edc12e4-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:03 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14" returned: 0 in 0.254s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14" released by "delete_volume" :: held 0.664s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Created reservations ['da5b0b53-dbb7-4e35-9afc-d98f38b617e1', '6843e8a8-d123-413f-a566-1b39350c46a8', 'a138d174-bd9d-46d0-ab3b-1379466e26c3', 'e2d8bcb2-b5c8-4446-97b7-8490a3392b4d'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:03 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:03 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:03 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.264s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:03 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Deleted volume successfully. Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-46943974-5cfc-496e-b262-1987616ecdd5-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c6fc8ddd-b5d5-4b1a-8c86-8946e5873e3e tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-54fdc3ec-11e5-4a3b-baee-6d0aa286aa14-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-46943974-5cfc-496e-b262-1987616ecdd5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-quobyte-46943974-5cfc-496e-b262-1987616ecdd5" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-46943974-5cfc-496e-b262-1987616ecdd5" acquired by "delete_volume" :: waited 0.025s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[753e05ed-31a6-4e98-b4e1-0140bddf00d4]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46943974-5cfc-496e-b262-1987616ecdd5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:04 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46943974-5cfc-496e-b262-1987616ecdd5 Jul 21 19:18:04 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:04 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46943974-5cfc-496e-b262-1987616ecdd5" returned: 0 in 0.380s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46943974-5cfc-496e-b262-1987616ecdd5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:04 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46943974-5cfc-496e-b262-1987616ecdd5 Jul 21 19:18:04 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:04 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46943974-5cfc-496e-b262-1987616ecdd5" returned: 0 in 0.265s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-46943974-5cfc-496e-b262-1987616ecdd5" released by "delete_volume" :: held 0.697s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Created reservations ['4c7080ab-f0f7-4923-8fb4-8f642be4017f', '1bd99615-66b4-4b09-8331-96b34ee5097e', '2768db59-6db8-4285-acbe-fc0ddc2d0e85', 'e483bc78-cc5c-453b-8ab4-2f477f3705ee'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:04 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:04 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:05 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-ed526b43-f39c-463f-811b-12d0fc46d2ff-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.272s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Deleted volume successfully. Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-ed526b43-f39c-463f-811b-12d0fc46d2ff-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-67c68074-6926-4c3f-b026-c96eea590e84 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-46943974-5cfc-496e-b262-1987616ecdd5-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-quobyte-ed526b43-f39c-463f-811b-12d0fc46d2ff" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-ed526b43-f39c-463f-811b-12d0fc46d2ff" acquired by "delete_volume" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfe7328-e9af-438e-b470-cf252b707548]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed526b43-f39c-463f-811b-12d0fc46d2ff {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:05 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed526b43-f39c-463f-811b-12d0fc46d2ff Jul 21 19:18:05 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:05 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed526b43-f39c-463f-811b-12d0fc46d2ff" returned: 0 in 0.353s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed526b43-f39c-463f-811b-12d0fc46d2ff {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:05 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed526b43-f39c-463f-811b-12d0fc46d2ff Jul 21 19:18:05 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:05 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ed526b43-f39c-463f-811b-12d0fc46d2ff" returned: 0 in 0.242s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-ed526b43-f39c-463f-811b-12d0fc46d2ff" released by "delete_volume" :: held 0.635s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Created reservations ['bb3e1604-f662-40b8-aae5-f541292c5fc2', 'd46651fe-c8d1-4164-b683-d9e6d3c4f3ce', 'b471700f-d361-46fb-a67f-e4bf9cd26533', '3e2c0eff-a299-4db9-a770-812daaaa8eda'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:06 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:06 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:06 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.246s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:06 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Deleted volume successfully. Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3bc5e77a-7f60-4389-9cf5-fb2c04120284 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-ed526b43-f39c-463f-811b-12d0fc46d2ff-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-df202e99-f8ad-4e8e-b989-f746f137a109-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-df202e99-f8ad-4e8e-b989-f746f137a109-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-quobyte-0f3b4f86-8ab2-43d6-a117-8501bce97f27" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-0f3b4f86-8ab2-43d6-a117-8501bce97f27" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-quobyte-df202e99-f8ad-4e8e-b989-f746f137a109" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-df202e99-f8ad-4e8e-b989-f746f137a109" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Deleting offline snapshot df202e99-f8ad-4e8e-b989-f746f137a109 of volume 0f3b4f86-8ab2-43d6-a117-8501bce97f27 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] snapshot_file for this snap is: volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f588b342-a56b-4ec7-bcd1-ce16c7970b4f]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:06 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 Jul 21 19:18:06 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:06 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109" returned: 0 in 0.376s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad16981d-eac4-49d7-904b-cbf2a44caa22]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:06 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 Jul 21 19:18:06 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:07 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27" returned: 0 in 0.364s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:07 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 Jul 21 19:18:07 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:07 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109" returned: 0 in 0.349s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:07 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109 Jul 21 19:18:07 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:07 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27.df202e99-f8ad-4e8e-b989-f746f137a109" returned: 0 in 0.276s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-df202e99-f8ad-4e8e-b989-f746f137a109" released by "_delete_snapshot" :: held 1.480s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-0f3b4f86-8ab2-43d6-a117-8501bce97f27" released by "delete_snapshot" :: held 1.503s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:07 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Created reservations ['4a59cee1-d210-48c5-8dce-c81ff7bb96e6', 'ebc88226-12c9-48a4-89aa-9abebbfe0749', '65fac352-45dc-4eec-a948-52998d9ab5a2', '1ea74d95-3f91-4570-9902-90401d11bf31'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:07 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Delete snapshot completed successfully. Jul 21 19:18:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0e6d8ec2-11b4-4f59-812b-bc23b2294732 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-df202e99-f8ad-4e8e-b989-f746f137a109-delete_snapshot" released by "delete_snapshot" :: held 1.637s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-0f3b4f86-8ab2-43d6-a117-8501bce97f27-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-0f3b4f86-8ab2-43d6-a117-8501bce97f27-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "cinder-quobyte-0f3b4f86-8ab2-43d6-a117-8501bce97f27" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-0f3b4f86-8ab2-43d6-a117-8501bce97f27" acquired by "delete_volume" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:08 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b026eb63-3257-42d1-993f-de6ffc659620]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:08 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 Jul 21 19:18:08 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:08 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27" returned: 0 in 0.365s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:08 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27 Jul 21 19:18:08 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:09 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f3b4f86-8ab2-43d6-a117-8501bce97f27" returned: 0 in 0.260s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-quobyte-0f3b4f86-8ab2-43d6-a117-8501bce97f27" released by "delete_volume" :: held 0.678s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:09 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Created reservations ['6a242f4b-db93-4dfd-a9a0-726dbbd75035', 'a486dc17-dbc5-4f7c-9e6e-87526334b9a1', '25ccb969-bbe9-4b69-85bb-9c137eebf23f', '0074b51c-cc63-4806-a0eb-bcdf2571366c'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:09 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:09 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:09 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.267s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:09 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:09 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Deleted volume successfully. Jul 21 19:18:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-1c1bd30b-31e7-4237-882d-6c2e701d22b1 tempest-CreateVolumesFromSnapshotTest-346309554 None] Lock "cinder-0f3b4f86-8ab2-43d6-a117-8501bce97f27-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:12 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Flow 'volume_create_manager' (2942a266-460c-4feb-a718-57fbd8f683b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df81d371-1145-4988-987d-e6af6be3bdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df81d371-1145-4988-987d-e6af6be3bdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656695663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=088b8c65-908e-492e-921c-29fcda3b36b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093d016c2059405ea8ddfee41a33aebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:13Z,use_quota=True,user_id='8cf9b42686bf406397aecd1dd6e37bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc389a1-0374-4101-98ba-597d32a4821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc389a1-0374-4101-98ba-597d32a4821f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e862d7-b29b-4868-a634-d59c1183e6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e862d7-b29b-4868-a634-d59c1183e6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '088b8c65-908e-492e-921c-29fcda3b36b0', 'volume_name': 'volume-088b8c65-908e-492e-921c-29fcda3b36b0', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6836adc6-f9c8-40df-9098-cebd5893c391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6836adc6-f9c8-40df-9098-cebd5893c391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c2a215-cd17-4130-89bc-cd9f47c07ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:13 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Volume 088b8c65-908e-492e-921c-29fcda3b36b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-088b8c65-908e-492e-921c-29fcda3b36b0', 'volume_size': 1} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656695663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=088b8c65-908e-492e-921c-29fcda3b36b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093d016c2059405ea8ddfee41a33aebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:13Z,use_quota=True,user_id='8cf9b42686bf406397aecd1dd6e37bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Creating volume 088b8c65-908e-492e-921c-29fcda3b36b0 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:13 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-088b8c65-908e-492e-921c-29fcda3b36b0 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:13 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-088b8c65-908e-492e-921c-29fcda3b36b0 1073741824 Jul 21 19:18:13 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:13 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-088b8c65-908e-492e-921c-29fcda3b36b0 1073741824" returned: 0 in 0.404s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-088b8c65-908e-492e-921c-29fcda3b36b0 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:13 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-088b8c65-908e-492e-921c-29fcda3b36b0 Jul 21 19:18:13 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:13 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-088b8c65-908e-492e-921c-29fcda3b36b0" returned: 0 in 0.246s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c2a215-cd17-4130-89bc-cd9f47c07ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-088b8c65-908e-492e-921c-29fcda3b36b0', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0bb1353-b031-439e-872c-74c61ac97ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:13 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Volume volume-088b8c65-908e-492e-921c-29fcda3b36b0 (088b8c65-908e-492e-921c-29fcda3b36b0): created successfully Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0bb1353-b031-439e-872c-74c61ac97ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Flow 'volume_create_manager' (2942a266-460c-4feb-a718-57fbd8f683b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:13 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-fcf68de0-5920-465a-9c19-8ac5a4a1e03b tempest-ProjectReaderTests-735255375 None] Created volume successfully. Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Acquiring lock "cinder-088b8c65-908e-492e-921c-29fcda3b36b0-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Lock "cinder-088b8c65-908e-492e-921c-29fcda3b36b0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Acquiring lock "cinder-quobyte-088b8c65-908e-492e-921c-29fcda3b36b0" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Lock "cinder-quobyte-088b8c65-908e-492e-921c-29fcda3b36b0" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d4b573-570c-4ca3-ab98-394b03531a37]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-088b8c65-908e-492e-921c-29fcda3b36b0 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:14 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-088b8c65-908e-492e-921c-29fcda3b36b0 Jul 21 19:18:14 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:14 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-088b8c65-908e-492e-921c-29fcda3b36b0" returned: 0 in 0.351s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-088b8c65-908e-492e-921c-29fcda3b36b0 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:14 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-088b8c65-908e-492e-921c-29fcda3b36b0 Jul 21 19:18:14 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:14 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-088b8c65-908e-492e-921c-29fcda3b36b0" returned: 0 in 0.243s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Lock "cinder-quobyte-088b8c65-908e-492e-921c-29fcda3b36b0" released by "delete_volume" :: held 0.632s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Created reservations ['42d4cf19-15d5-4ee4-8352-fa3e7698b48b', '13d7cfde-7403-4d57-8f36-fecebbdd2805', '9599389f-704d-4984-be4c-25d0f46b6700', 'ae80990e-1e6d-422a-89c1-b7d2b51a71ad'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:14 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:14 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:15 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.226s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:15 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Deleted volume successfully. Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c613897c-f585-4b20-aa39-e0725024be32 tempest-ProjectReaderTests-735255375 None] Lock "cinder-088b8c65-908e-492e-921c-29fcda3b36b0-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Flow 'volume_create_manager' (6d849496-8fad-42c8-b8fd-2fd34a91d68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae487bf-2d00-40a0-a64d-40d6b67fb55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae487bf-2d00-40a0-a64d-40d6b67fb55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387278752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e708d8-af00-4e8e-9e86-4720b1d7d0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093d016c2059405ea8ddfee41a33aebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:16Z,use_quota=True,user_id='8cf9b42686bf406397aecd1dd6e37bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fff741-207d-446d-8466-2afd12a74aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fff741-207d-446d-8466-2afd12a74aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2c0d87-76e0-496f-9812-15e8b8ec78bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2c0d87-76e0-496f-9812-15e8b8ec78bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e708d8-af00-4e8e-9e86-4720b1d7d0d4', 'volume_name': 'volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5075733-d312-449c-9d03-4405d6781c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5075733-d312-449c-9d03-4405d6781c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3bd374-e2f8-491c-a182-186fdbdd9a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:15 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Volume f9e708d8-af00-4e8e-9e86-4720b1d7d0d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4', 'volume_size': 1} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387278752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e708d8-af00-4e8e-9e86-4720b1d7d0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093d016c2059405ea8ddfee41a33aebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:16Z,use_quota=True,user_id='8cf9b42686bf406397aecd1dd6e37bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Creating volume f9e708d8-af00-4e8e-9e86-4720b1d7d0d4 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:15 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:15 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4 1073741824 Jul 21 19:18:15 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:16 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4 1073741824" returned: 0 in 0.436s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:16 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4 Jul 21 19:18:16 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:16 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4" returned: 0 in 0.238s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3bd374-e2f8-491c-a182-186fdbdd9a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9c43f4-5313-4315-ba57-196e9057735b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:16 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Volume volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4 (f9e708d8-af00-4e8e-9e86-4720b1d7d0d4): created successfully Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9c43f4-5313-4315-ba57-196e9057735b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Flow 'volume_create_manager' (6d849496-8fad-42c8-b8fd-2fd34a91d68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:16 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-dd66d661-5d69-4434-9372-ab3fa3a732ae tempest-ProjectReaderTests-735255375 None] Created volume successfully. Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Acquiring lock "cinder-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Lock "cinder-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Acquiring lock "cinder-quobyte-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Lock "cinder-quobyte-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4" acquired by "delete_volume" :: waited 0.012s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ea7663-7713-4598-a25f-7f269e49c9b2]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:16 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4 Jul 21 19:18:16 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:17 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4" returned: 0 in 0.339s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:17 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4 Jul 21 19:18:17 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:17 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4" returned: 0 in 0.226s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Lock "cinder-quobyte-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4" released by "delete_volume" :: held 0.604s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:17 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Created reservations ['7dc3590f-f45e-401f-8f1a-21a26f763db2', '8e591b9a-04e3-463e-a2d9-c55ad290f2a8', 'f7425a2a-6d47-4e65-a305-eaa126ce0111', '702fb5b1-87a9-4f30-a78e-62614a2f36ad'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:17 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:17 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:17 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.235s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:17 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:17 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Deleted volume successfully. Jul 21 19:18:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-50640625-0aa5-4897-b150-17ae6b54e9b1 tempest-ProjectReaderTests-735255375 None] Lock "cinder-f9e708d8-af00-4e8e-9e86-4720b1d7d0d4-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Flow 'volume_create_manager' (cfd79463-6bf4-484b-b23c-39958bbb4b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf231617-f913-4ca3-851e-c1d5ae7e4703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf231617-f913-4ca3-851e-c1d5ae7e4703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10201723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdbda59-f391-4f53-b42f-b49ded4c0b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c646468039a4b4b8617ff505855f0f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:22Z,use_quota=True,user_id='90e16293903d4c5895682bf6fd72eca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd3509b-8915-4b91-b1e7-5b73e7ad6c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd3509b-8915-4b91-b1e7-5b73e7ad6c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe42772-6d59-4624-be63-c0cbf8e05c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe42772-6d59-4624-be63-c0cbf8e05c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebdbda59-f391-4f53-b42f-b49ded4c0b0c', 'volume_name': 'volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2164fa70-a125-4361-854d-a8e18bacc5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2164fa70-a125-4361-854d-a8e18bacc5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de30499-f28d-4b6d-b3fb-e3493ba24a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:21 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Volume ebdbda59-f391-4f53-b42f-b49ded4c0b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c', 'volume_size': 1} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10201723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdbda59-f391-4f53-b42f-b49ded4c0b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c646468039a4b4b8617ff505855f0f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:22Z,use_quota=True,user_id='90e16293903d4c5895682bf6fd72eca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Creating volume ebdbda59-f391-4f53-b42f-b49ded4c0b0c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:21 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:21 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c 1073741824 Jul 21 19:18:21 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:22 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c 1073741824" returned: 0 in 0.414s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:22 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c Jul 21 19:18:22 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:22 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c" returned: 0 in 0.239s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de30499-f28d-4b6d-b3fb-e3493ba24a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06f9092-1260-4e15-aa83-fe0b481fac46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:22 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Volume volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c (ebdbda59-f391-4f53-b42f-b49ded4c0b0c): created successfully Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06f9092-1260-4e15-aa83-fe0b481fac46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Flow 'volume_create_manager' (cfd79463-6bf4-484b-b23c-39958bbb4b9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:22 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b41286f7-af9f-4a26-8849-4e1db12de45b tempest-ProjectReaderTests-2130741954 None] Created volume successfully. Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Acquiring lock "cinder-ebdbda59-f391-4f53-b42f-b49ded4c0b0c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Lock "cinder-ebdbda59-f391-4f53-b42f-b49ded4c0b0c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Acquiring lock "cinder-quobyte-ebdbda59-f391-4f53-b42f-b49ded4c0b0c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Lock "cinder-quobyte-ebdbda59-f391-4f53-b42f-b49ded4c0b0c" acquired by "delete_volume" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1064144-b285-423d-9717-2db6fc96a2aa]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:22 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c Jul 21 19:18:22 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:23 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c" returned: 0 in 0.368s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:23 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c Jul 21 19:18:23 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:23 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ebdbda59-f391-4f53-b42f-b49ded4c0b0c" returned: 0 in 0.282s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Lock "cinder-quobyte-ebdbda59-f391-4f53-b42f-b49ded4c0b0c" released by "delete_volume" :: held 0.697s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:23 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Created reservations ['c07efa9f-829c-42c7-8c62-72a88a1db574', '65c0acc6-bb63-42a9-b72f-f374322fec35', '43b61c0e-b0e9-4a1a-ab45-730a54751d02', 'ca2496be-beab-408f-817b-7273ebfecfd5'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:23 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:23 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:23 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.267s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:23 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:23 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Deleted volume successfully. Jul 21 19:18:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-417a2097-baca-45bf-b91e-1d4db5ef6ffb tempest-ProjectReaderTests-2130741954 None] Lock "cinder-ebdbda59-f391-4f53-b42f-b49ded4c0b0c-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Flow 'volume_create_manager' (2ec38d3d-4fd1-4b8a-86ef-823d8eb0e7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (431a8688-ab33-498f-b7e3-9f2e6e8dad2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (431a8688-ab33-498f-b7e3-9f2e6e8dad2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-466707735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c646468039a4b4b8617ff505855f0f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:24Z,use_quota=True,user_id='90e16293903d4c5895682bf6fd72eca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8ac1f1-8280-422d-b238-26376b49108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8ac1f1-8280-422d-b238-26376b49108e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (945b17be-1b92-4044-8030-f5c49f262642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (945b17be-1b92-4044-8030-f5c49f262642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8', 'volume_name': 'volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c7cb0a-3f51-4563-99f1-c87b4d2b8425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c7cb0a-3f51-4563-99f1-c87b4d2b8425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d31cc17-b0db-446e-a84c-a9c89f0c97c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:24 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Volume c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8', 'volume_size': 1} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-466707735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c646468039a4b4b8617ff505855f0f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:24Z,use_quota=True,user_id='90e16293903d4c5895682bf6fd72eca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Creating volume c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:24 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:24 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8 1073741824 Jul 21 19:18:24 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:24 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8 1073741824" returned: 0 in 0.436s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:25 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8 Jul 21 19:18:25 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:25 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8" returned: 0 in 0.275s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d31cc17-b0db-446e-a84c-a9c89f0c97c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a712e585-306c-424a-b131-d36514172a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:25 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Volume volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8 (c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8): created successfully Jul 21 19:18:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a712e585-306c-424a-b131-d36514172a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Flow 'volume_create_manager' (2ec38d3d-4fd1-4b8a-86ef-823d8eb0e7fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-afe8440d-9565-4b13-a594-78aeb0bffcb9 tempest-ProjectReaderTests-2130741954 None] Created volume successfully. Jul 21 19:18:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Acquiring lock "cinder-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Lock "cinder-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Acquiring lock "cinder-quobyte-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Lock "cinder-quobyte-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:26 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0db994-1c5f-4422-b3d0-928448cf3a64]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:26 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8 Jul 21 19:18:26 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:26 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8" returned: 0 in 0.362s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:27 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8 Jul 21 19:18:27 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:27 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8" returned: 0 in 0.242s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Lock "cinder-quobyte-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8" released by "delete_volume" :: held 0.641s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:27 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Created reservations ['bc177c90-211c-49c0-8bcb-d4e0b95abb1d', 'c5a430a4-71b3-4d47-be74-0fb20048ef50', 'f81c7cb5-3803-47cc-803a-32225db3a8fe', '59621c93-ba37-4230-abfb-36fa1414b77c'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:27 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:27 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:27 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.256s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:27 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:27 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Deleted volume successfully. Jul 21 19:18:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-79c78e67-4810-47cb-932d-638552806ad8 tempest-ProjectReaderTests-2130741954 None] Lock "cinder-c4b0b3ee-cb8c-44ab-bb5b-5160688abdc8-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Flow 'volume_create_manager' (e9cbc3ee-65bd-4ae0-92ca-bd3abbb2c9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d71ac0-ff46-4966-aa7c-11b748e6adaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d71ac0-ff46-4966-aa7c-11b748e6adaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-608510743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5f2e87-86ba-4e7c-b975-5a1e72a692cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c646468039a4b4b8617ff505855f0f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:28Z,use_quota=True,user_id='90e16293903d4c5895682bf6fd72eca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f312cd0-e6f4-4f5d-8737-35b4006d5877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f312cd0-e6f4-4f5d-8737-35b4006d5877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4aebca-a2d4-40ab-b9e8-1e8f00f59e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4aebca-a2d4-40ab-b9e8-1e8f00f59e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea5f2e87-86ba-4e7c-b975-5a1e72a692cf', 'volume_name': 'volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bed54da-72ce-41b2-97df-e759043a5dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bed54da-72ce-41b2-97df-e759043a5dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6353789e-cd0b-4bb6-9ac9-028b02e47ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:28 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Volume ea5f2e87-86ba-4e7c-b975-5a1e72a692cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf', 'volume_size': 1} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-608510743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5f2e87-86ba-4e7c-b975-5a1e72a692cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c646468039a4b4b8617ff505855f0f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:28Z,use_quota=True,user_id='90e16293903d4c5895682bf6fd72eca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Creating volume ea5f2e87-86ba-4e7c-b975-5a1e72a692cf {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:28 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:28 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf 1073741824 Jul 21 19:18:28 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:28 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf 1073741824" returned: 0 in 0.395s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:28 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf Jul 21 19:18:28 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:28 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf" returned: 0 in 0.226s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6353789e-cd0b-4bb6-9ac9-028b02e47ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1a2a65-9dd1-49af-b2cf-e971dd8e7ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:28 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Volume volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf (ea5f2e87-86ba-4e7c-b975-5a1e72a692cf): created successfully Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1a2a65-9dd1-49af-b2cf-e971dd8e7ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Flow 'volume_create_manager' (e9cbc3ee-65bd-4ae0-92ca-bd3abbb2c9a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:28 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5bc37adf-c413-400c-a69e-1587abad9a50 tempest-ProjectReaderTests-2130741954 None] Created volume successfully. Jul 21 19:18:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Acquiring lock "cinder-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Lock "cinder-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Acquiring lock "cinder-quobyte-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Lock "cinder-quobyte-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:29 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31a4df1-49a4-4659-b57b-67f21be66d22]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:29 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf Jul 21 19:18:29 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:29 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf" returned: 0 in 0.353s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:29 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf Jul 21 19:18:29 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:29 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf" returned: 0 in 0.254s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Lock "cinder-quobyte-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf" released by "delete_volume" :: held 0.644s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:29 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Created reservations ['f1089d0d-57ff-43c8-bc90-f14f02deb768', 'e4e9d2ae-d608-40f9-b6fd-1d653d6d0c66', 'ea4eb8e3-f17b-45f3-8762-fce3597888de', 'f4ca10bf-8d96-4b16-a73d-4ddceb8d52c0'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:30 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:30 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:30 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.254s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:30 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Deleted volume successfully. Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6aef02d2-ad34-43a0-b101-49b7452cdd92 tempest-ProjectReaderTests-2130741954 None] Lock "cinder-ea5f2e87-86ba-4e7c-b975-5a1e72a692cf-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Flow 'volume_create_manager' (0891160d-ba77-41b9-8062-47d1249b9a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088bd58d-fb9d-4985-a104-ccd73f77f05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088bd58d-fb9d-4985-a104-ccd73f77f05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875179597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebde8c2-a259-407d-830c-73ad422ca81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c646468039a4b4b8617ff505855f0f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:31Z,use_quota=True,user_id='90e16293903d4c5895682bf6fd72eca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df7d856-ac1d-44c0-9bf6-9811fab9ea7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df7d856-ac1d-44c0-9bf6-9811fab9ea7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336b6ffb-7d70-495a-b685-261515ba194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336b6ffb-7d70-495a-b685-261515ba194f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebde8c2-a259-407d-830c-73ad422ca81e', 'volume_name': 'volume-2ebde8c2-a259-407d-830c-73ad422ca81e', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410d28a6-c539-4cfa-a874-280ffd146d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410d28a6-c539-4cfa-a874-280ffd146d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8c8a90-ab22-440a-8564-3bf39a78d386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:30 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Volume 2ebde8c2-a259-407d-830c-73ad422ca81e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebde8c2-a259-407d-830c-73ad422ca81e', 'volume_size': 1} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875179597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebde8c2-a259-407d-830c-73ad422ca81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c646468039a4b4b8617ff505855f0f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:31Z,use_quota=True,user_id='90e16293903d4c5895682bf6fd72eca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Creating volume 2ebde8c2-a259-407d-830c-73ad422ca81e {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:30 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2ebde8c2-a259-407d-830c-73ad422ca81e 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:30 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2ebde8c2-a259-407d-830c-73ad422ca81e 1073741824 Jul 21 19:18:30 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:31 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2ebde8c2-a259-407d-830c-73ad422ca81e 1073741824" returned: 0 in 0.412s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2ebde8c2-a259-407d-830c-73ad422ca81e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:31 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2ebde8c2-a259-407d-830c-73ad422ca81e Jul 21 19:18:31 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:31 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2ebde8c2-a259-407d-830c-73ad422ca81e" returned: 0 in 0.243s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8c8a90-ab22-440a-8564-3bf39a78d386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebde8c2-a259-407d-830c-73ad422ca81e', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec92633c-c29f-422a-91f3-823cac8ca1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:31 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Volume volume-2ebde8c2-a259-407d-830c-73ad422ca81e (2ebde8c2-a259-407d-830c-73ad422ca81e): created successfully Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec92633c-c29f-422a-91f3-823cac8ca1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Flow 'volume_create_manager' (0891160d-ba77-41b9-8062-47d1249b9a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:31 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b0c356b4-b91d-422e-9abe-fe97bd2a796e tempest-ProjectReaderTests-2130741954 None] Created volume successfully. Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Acquiring lock "cinder-2ebde8c2-a259-407d-830c-73ad422ca81e-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Lock "cinder-2ebde8c2-a259-407d-830c-73ad422ca81e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Acquiring lock "cinder-quobyte-2ebde8c2-a259-407d-830c-73ad422ca81e" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Lock "cinder-quobyte-2ebde8c2-a259-407d-830c-73ad422ca81e" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeb9be8-0609-4465-936b-831a179dddb0]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2ebde8c2-a259-407d-830c-73ad422ca81e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:32 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2ebde8c2-a259-407d-830c-73ad422ca81e Jul 21 19:18:32 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:32 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2ebde8c2-a259-407d-830c-73ad422ca81e" returned: 0 in 0.386s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2ebde8c2-a259-407d-830c-73ad422ca81e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:32 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2ebde8c2-a259-407d-830c-73ad422ca81e Jul 21 19:18:32 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:32 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2ebde8c2-a259-407d-830c-73ad422ca81e" returned: 0 in 0.264s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Lock "cinder-quobyte-2ebde8c2-a259-407d-830c-73ad422ca81e" released by "delete_volume" :: held 0.689s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:32 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Created reservations ['42aa55a8-4027-48fe-9dae-8a26d17b3942', '90474796-9c93-47a2-93e2-5c93acbff144', '117efb9a-980c-4478-a522-25d6b9da81f4', '8f0dc538-86e9-4273-81ee-44ae9d9e32ec'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:32 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:32 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:33 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.255s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:33 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:33 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Deleted volume successfully. Jul 21 19:18:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-16b61968-285f-4a95-8fa2-dd9707ef397c tempest-ProjectReaderTests-2130741954 None] Lock "cinder-2ebde8c2-a259-407d-830c-73ad422ca81e-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:18:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:40 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:40 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:40 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.283s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:40 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:18:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:18:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:18:42 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:UPDATE=150,cinder:SELECT=102,cinder:DELETE=10,cinder:INSERT=27 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Flow 'volume_create_manager' (6a136f08-b47b-42b9-8927-2dc17cc6b41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059db201-5452-4db7-bf6b-f55a2d7b1329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059db201-5452-4db7-bf6b-f55a2d7b1329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1467228086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095aae74caa543d4aaa190c098640315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:45Z,use_quota=True,user_id='bfcee1d95a5d413592611c5474b190d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36a4397-314f-4fe1-8c63-9fb8c866c648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36a4397-314f-4fe1-8c63-9fb8c866c648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a3e7de-eebd-41ec-b063-9a0a7c9a4485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a3e7de-eebd-41ec-b063-9a0a7c9a4485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1', 'volume_name': 'volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19a326b-165a-4a59-a908-237770b8d708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19a326b-165a-4a59-a908-237770b8d708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be06f5b-98a3-4d1f-97a1-347c7025de6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume 6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1', 'volume_size': 1} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1467228086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095aae74caa543d4aaa190c098640315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:45Z,use_quota=True,user_id='bfcee1d95a5d413592611c5474b190d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Creating volume 6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:45 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:45 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1 1073741824 Jul 21 19:18:45 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Flow 'volume_create_manager' (3bca6e84-6f10-46df-a151-22c2289fba7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c92bdd-cddc-402a-af30-42cb49077275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c92bdd-cddc-402a-af30-42cb49077275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-602175956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209f3516-c816-4806-803f-6c359fbb384d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977148c79cf142288fadbfd059edf1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:46Z,use_quota=True,user_id='858491de1a3e4d50ab5a483ebdaf130f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3663b884-d1e8-40f4-b599-b16de62d3e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3663b884-d1e8-40f4-b599-b16de62d3e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71adaf4-fcb7-4572-b64c-eba587f26846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71adaf4-fcb7-4572-b64c-eba587f26846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209f3516-c816-4806-803f-6c359fbb384d', 'volume_name': 'volume-209f3516-c816-4806-803f-6c359fbb384d', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f97c0db-8bfe-4606-a069-27b81c7a8ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f97c0db-8bfe-4606-a069-27b81c7a8ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335777bc-89e8-49cf-b8e1-82099e6f2c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Volume 209f3516-c816-4806-803f-6c359fbb384d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209f3516-c816-4806-803f-6c359fbb384d', 'volume_size': 1} Jul 21 19:18:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:46 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1 1073741824" returned: 0 in 0.512s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:46 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1 Jul 21 19:18:46 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:46 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1" returned: 0 in 0.297s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-602175956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209f3516-c816-4806-803f-6c359fbb384d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977148c79cf142288fadbfd059edf1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:46Z,use_quota=True,user_id='858491de1a3e4d50ab5a483ebdaf130f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Creating volume 209f3516-c816-4806-803f-6c359fbb384d {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:46 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be06f5b-98a3-4d1f-97a1-347c7025de6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:46 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d 1073741824 Jul 21 19:18:46 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07cd1ad-4e7c-434d-a872-abe971d7e97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:46 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1 (6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1): created successfully Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07cd1ad-4e7c-434d-a872-abe971d7e97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:46 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Flow 'volume_create_manager' (6a136f08-b47b-42b9-8927-2dc17cc6b41e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:46 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-72bbd260-9a25-4e9f-bbd2-fda45c3d361b tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Created volume successfully. Jul 21 19:18:47 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d 1073741824" returned: 0 in 0.484s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:47 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d Jul 21 19:18:47 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:47 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d" returned: 0 in 0.296s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335777bc-89e8-49cf-b8e1-82099e6f2c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209f3516-c816-4806-803f-6c359fbb384d', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85aa6a4b-ad27-41e6-9f47-a9ff7e5c4bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:47 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Volume volume-209f3516-c816-4806-803f-6c359fbb384d (209f3516-c816-4806-803f-6c359fbb384d): created successfully Jul 21 19:18:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85aa6a4b-ad27-41e6-9f47-a9ff7e5c4bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:47 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Flow 'volume_create_manager' (3bca6e84-6f10-46df-a151-22c2289fba7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:47 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-84c78a48-7eb2-42a3-97f6-be3d2bcb8297 tempest-VolumeDependencyTests-1591925916 None] Created volume successfully. Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Flow 'volume_create_manager' (5e80b2a8-a3a8-4273-8827-e9b9223bbf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8463b9d-0b7f-4eaa-b050-18f231459f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8463b9d-0b7f-4eaa-b050-18f231459f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2089718342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998a376a-dc15-42b5-b067-14ecc0e68b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095aae74caa543d4aaa190c098640315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:48Z,use_quota=True,user_id='bfcee1d95a5d413592611c5474b190d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84bc3c9-ed3e-4f78-b781-2571bf66155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84bc3c9-ed3e-4f78-b781-2571bf66155a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cd779c-178c-488b-8223-c9dbed6809d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cd779c-178c-488b-8223-c9dbed6809d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '998a376a-dc15-42b5-b067-14ecc0e68b3c', 'volume_name': 'volume-998a376a-dc15-42b5-b067-14ecc0e68b3c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69bc0f9d-4900-4f2e-ad9c-5e929cdbcb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69bc0f9d-4900-4f2e-ad9c-5e929cdbcb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0062f36-03f2-437f-890e-94f5b1f0d6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume 998a376a-dc15-42b5-b067-14ecc0e68b3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-998a376a-dc15-42b5-b067-14ecc0e68b3c', 'volume_size': 1} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2089718342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998a376a-dc15-42b5-b067-14ecc0e68b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095aae74caa543d4aaa190c098640315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:48Z,use_quota=True,user_id='bfcee1d95a5d413592611c5474b190d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Creating volume 998a376a-dc15-42b5-b067-14ecc0e68b3c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:48 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-998a376a-dc15-42b5-b067-14ecc0e68b3c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:48 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-998a376a-dc15-42b5-b067-14ecc0e68b3c 1073741824 Jul 21 19:18:48 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Flow 'volume_create_manager' (1ce89a3f-6e62-4076-a1c7-0fa1d5c483f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baca45cf-39c6-4ac4-aaf1-07fc593659e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=122,cinder:UPDATE=172,cinder:INSERT=54,cinder:DELETE=17 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baca45cf-39c6-4ac4-aaf1-07fc593659e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cbbcfd-7248-43bc-be8e-77a22d7961dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c4fba9f622f4c6c938e5242d4972d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:49Z,use_quota=True,user_id='cc1eeff0346a4013860f85c2145802d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36adf15c-bf90-4f94-9250-f7440e0f1ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36adf15c-bf90-4f94-9250-f7440e0f1ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fac1265-95ba-49fc-85bb-4d320d46eec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.image.glance [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Creating Keystone auth plugin from conf {{(pid=87487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Flow 'volume_create_manager' (be776d81-d7c0-4ec0-a7e9-6d6b8b70860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58756f2c-a2d3-41dd-9632-0f4e077de33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58756f2c-a2d3-41dd-9632-0f4e077de33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1478975002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e997fda-55a7-4ba6-ae47-94ee0ccba180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095aae74caa543d4aaa190c098640315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:49Z,use_quota=True,user_id='bfcee1d95a5d413592611c5474b190d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515217ca-df5d-45ce-b5b5-a4de9c4c89a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515217ca-df5d-45ce-b5b5-a4de9c4c89a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73eaa64b-d1a5-41f8-8d70-afe4b5dbf366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73eaa64b-d1a5-41f8-8d70-afe4b5dbf366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e997fda-55a7-4ba6-ae47-94ee0ccba180', 'volume_name': 'volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8cbab8-4bc5-4a94-8e77-fcd8715a766d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8cbab8-4bc5-4a94-8e77-fcd8715a766d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8427e833-92f1-4651-8e38-9cecfe4814f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume 3e997fda-55a7-4ba6-ae47-94ee0ccba180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180', 'volume_size': 1} Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:48 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-998a376a-dc15-42b5-b067-14ecc0e68b3c 1073741824" returned: 0 in 0.704s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Flow 'volume_create_manager' (307b117b-a1b7-44d7-85b8-bf06ca782c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b851c6-ac51-4833-be34-df72f8a2c672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-998a376a-dc15-42b5-b067-14ecc0e68b3c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b851c6-ac51-4833-be34-df72f8a2c672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2004106823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08510f46-9d44-4aef-b8ca-ac47ed851ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095aae74caa543d4aaa190c098640315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:49Z,use_quota=True,user_id='bfcee1d95a5d413592611c5474b190d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:49 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-998a376a-dc15-42b5-b067-14ecc0e68b3c Jul 21 19:18:49 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d4280b-f8e9-40e6-be1b-2a0b7d0333d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d4280b-f8e9-40e6-be1b-2a0b7d0333d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e464b9-d033-4171-8a09-208f213050c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e464b9-d033-4171-8a09-208f213050c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08510f46-9d44-4aef-b8ca-ac47ed851ce9', 'volume_name': 'volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfcda53-b565-46ff-8c7c-7304bc9a634b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfcda53-b565-46ff-8c7c-7304bc9a634b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d5fbe9-f518-4aa1-8da5-180b83fb5abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:49 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume 08510f46-9d44-4aef-b8ca-ac47ed851ce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9', 'volume_size': 1} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fac1265-95ba-49fc-85bb-4d320d46eec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69cbbcfd-7248-43bc-be8e-77a22d7961dd', 'volume_name': 'volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd', 'volume_size': 1, 'image_id': '045bb393-ce54-401d-a0b2-07d559c415b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/045bb393-ce54-401d-a0b2-07d559c415b4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7b9d6704d9bf0a4f2be7c5030c644ed5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4c4fba9f622f4c6c938e5242d4972d49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e5d64aef06bab9e7f42a8bde2c82d4d5e7822f3d4ea829456acd2918ce08094ffdaea160f8b696df2434843946a37af4b17ce121b7775b4919da0b3e7bf78d59', 'id': '045bb393-ce54-401d-a0b2-07d559c415b4', 'created_at': datetime.datetime(2026, 7, 21, 17, 18, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 18, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/045bb393-ce54-401d-a0b2-07d559c415b4/file', 'properties': {}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b99b9f7-cfa8-490e-9e85-a3ffcf92377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b99b9f7-cfa8-490e-9e85-a3ffcf92377a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b713a18-3e8a-4723-95a8-1deeb6d3e489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:49 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Volume 69cbbcfd-7248-43bc-be8e-77a22d7961dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd', 'volume_size': 1, 'image_id': '045bb393-ce54-401d-a0b2-07d559c415b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/045bb393-ce54-401d-a0b2-07d559c415b4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7b9d6704d9bf0a4f2be7c5030c644ed5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4c4fba9f622f4c6c938e5242d4972d49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e5d64aef06bab9e7f42a8bde2c82d4d5e7822f3d4ea829456acd2918ce08094ffdaea160f8b696df2434843946a37af4b17ce121b7775b4919da0b3e7bf78d59', 'id': '045bb393-ce54-401d-a0b2-07d559c415b4', 'created_at': datetime.datetime(2026, 7, 21, 17, 18, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 18, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/045bb393-ce54-401d-a0b2-07d559c415b4/file', 'properties': {}}, 'image_service': } Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Trying to clone 69cbbcfd-7248-43bc-be8e-77a22d7961dd from image 045bb393-ce54-401d-a0b2-07d559c415b4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/045bb393-ce54-401d-a0b2-07d559c415b4', 'metadata': {}}]). {{(pid=87487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:18:49 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Image download 0.00 MB at 0.00 MB/s Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc6d9f6-c9ab-447b-a954-693450e8e0b3]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:49 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-998a376a-dc15-42b5-b067-14ecc0e68b3c" returned: 0 in 0.395s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.534s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1478975002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e997fda-55a7-4ba6-ae47-94ee0ccba180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095aae74caa543d4aaa190c098640315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:49Z,use_quota=True,user_id='bfcee1d95a5d413592611c5474b190d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Creating volume 3e997fda-55a7-4ba6-ae47-94ee0ccba180 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:49 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:49 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD Jul 21 19:18:49 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0062f36-03f2-437f-890e-94f5b1f0d6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-998a376a-dc15-42b5-b067-14ecc0e68b3c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b696794-9c58-494c-8f9c-d57a46e5b79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:49 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180 1073741824 Jul 21 19:18:49 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:49 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume volume-998a376a-dc15-42b5-b067-14ecc0e68b3c (998a376a-dc15-42b5-b067-14ecc0e68b3c): created successfully Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b696794-9c58-494c-8f9c-d57a46e5b79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Flow 'volume_create_manager' (5e80b2a8-a3a8-4273-8827-e9b9223bbf2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:49 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c174c5eb-5595-467f-ba07-7c04bb88af02 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Created volume successfully. Jul 21 19:18:49 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:50 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD Jul 21 19:18:50 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:50 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180 1073741824" returned: 0 in 0.618s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Flow 'volume_create_manager' (80e510c5-4505-47cd-b8db-403c4a3ae137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b45a8e-481d-4e5b-96b5-4dcd9574b2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b45a8e-481d-4e5b-96b5-4dcd9574b2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1641842230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18aa025a-7cea-4baa-b648-16385fa0c559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095aae74caa543d4aaa190c098640315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:50Z,use_quota=True,user_id='bfcee1d95a5d413592611c5474b190d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e01bcf6-f6c9-49a5-9974-af98f9bbdf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e01bcf6-f6c9-49a5-9974-af98f9bbdf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a365bc9-58eb-446a-86e3-6043410d9fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a365bc9-58eb-446a-86e3-6043410d9fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18aa025a-7cea-4baa-b648-16385fa0c559', 'volume_name': 'volume-18aa025a-7cea-4baa-b648-16385fa0c559', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97691dc0-c15b-46eb-8f93-d98fbcf8f757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97691dc0-c15b-46eb-8f93-d98fbcf8f757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa4b5d2-7459-42db-bf99-6a0e18a42bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume 18aa025a-7cea-4baa-b648-16385fa0c559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18aa025a-7cea-4baa-b648-16385fa0c559', 'volume_size': 1} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:50 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:50 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180 Jul 21 19:18:50 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Flow 'volume_create_manager' (6ccb17f5-c013-46f7-90e0-f148cdb1b9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e6244f-3de8-498f-a673-a2e53041d0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD" returned: 1 in 0.467s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Temporary image 045bb393-ce54-401d-a0b2-07d559c415b4 is fetched for user cc1eeff0346a4013860f85c2145802d6. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e6244f-3de8-498f-a673-a2e53041d0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2fa75d5-ff6b-4b70-8c24-c33624be9ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ef8f5dea734f92a65b001434cb5605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:50Z,use_quota=True,user_id='afafcb436ed746a39b6aaaae806f4aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29e61c58-5cb6-4f82-8e2b-83383a5cd486),volume_type_id=29e61c58-5cb6-4f82-8e2b-83383a5cd486)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fda469-6619-4470-99ca-b3a1eaca6a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fda469-6619-4470-99ca-b3a1eaca6a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e872c604-c4a5-4683-a351-7cf994ed3572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.image.glance [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Creating Keystone auth plugin from conf {{(pid=87487) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Flow 'volume_create_manager' (48079af6-88a0-41ac-9c58-5a34dc945222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e914f4e7-089c-47bc-9f4c-12fab358ab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e914f4e7-089c-47bc-9f4c-12fab358ab9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1264847492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76cbf07e-588d-4566-a667-e4559b632c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095aae74caa543d4aaa190c098640315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:50Z,use_quota=True,user_id='bfcee1d95a5d413592611c5474b190d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b92284-f4b5-421d-849a-97d4a88c67af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b92284-f4b5-421d-849a-97d4a88c67af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273574fa-1da0-4179-a492-95e177dd7348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273574fa-1da0-4179-a492-95e177dd7348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76cbf07e-588d-4566-a667-e4559b632c91', 'volume_name': 'volume-76cbf07e-588d-4566-a667-e4559b632c91', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0913f3-813f-4775-bfe7-ff44fb466d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0913f3-813f-4775-bfe7-ff44fb466d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e51798b-c63c-4745-87dd-291f76a40613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume 76cbf07e-588d-4566-a667-e4559b632c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76cbf07e-588d-4566-a667-e4559b632c91', 'volume_size': 1} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9a25fa-909e-4843-a364-50b0a1f738bf]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:50 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180" returned: 0 in 0.266s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.382s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2004106823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08510f46-9d44-4aef-b8ca-ac47ed851ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095aae74caa543d4aaa190c098640315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:49Z,use_quota=True,user_id='bfcee1d95a5d413592611c5474b190d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Creating volume 08510f46-9d44-4aef-b8ca-ac47ed851ce9 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:50 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8427e833-92f1-4651-8e38-9cecfe4814f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9 1073741824 Jul 21 19:18:50 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e1fa15-7975-44f6-93ab-078d84c76e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180 (3e997fda-55a7-4ba6-ae47-94ee0ccba180): created successfully Jul 21 19:18:50 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD Jul 21 19:18:50 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e1fa15-7975-44f6-93ab-078d84c76e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Flow 'volume_create_manager' (be776d81-d7c0-4ec0-a7e9-6d6b8b70860e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:50 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-883c109c-f08d-48bc-b5cc-e0451c09d477 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Created volume successfully. Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e872c604-c4a5-4683-a351-7cf994ed3572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b2fa75d5-ff6b-4b70-8c24-c33624be9ce1', 'volume_name': 'volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1', 'volume_size': 1, 'image_id': 'fa78b124-1e8a-4232-916e-5c2fd205715e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa78b124-1e8a-4232-916e-5c2fd205715e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7a638586ddbbe6a7febb032fb69c894a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4ef8f5dea734f92a65b001434cb5605', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16a6d6aacf5b6fe91461eec32cba3986e7f86042141037d057d6c9a5b61abcb949a27a2196bce568b5d33efb2676619dfc4e77b8f1f271988a5337b3445ed672', 'id': 'fa78b124-1e8a-4232-916e-5c2fd205715e', 'created_at': datetime.datetime(2026, 7, 21, 17, 18, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 18, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa78b124-1e8a-4232-916e-5c2fd205715e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1718bc71-1661-439a-82bd-e95946f1f504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1718bc71-1661-439a-82bd-e95946f1f504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f056fa3-8684-4027-96c7-2a07685d01b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Volume b2fa75d5-ff6b-4b70-8c24-c33624be9ce1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1', 'volume_size': 1, 'image_id': 'fa78b124-1e8a-4232-916e-5c2fd205715e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa78b124-1e8a-4232-916e-5c2fd205715e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7a638586ddbbe6a7febb032fb69c894a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4ef8f5dea734f92a65b001434cb5605', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16a6d6aacf5b6fe91461eec32cba3986e7f86042141037d057d6c9a5b61abcb949a27a2196bce568b5d33efb2676619dfc4e77b8f1f271988a5337b3445ed672', 'id': 'fa78b124-1e8a-4232-916e-5c2fd205715e', 'created_at': datetime.datetime(2026, 7, 21, 17, 18, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 18, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa78b124-1e8a-4232-916e-5c2fd205715e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Trying to clone b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 from image fa78b124-1e8a-4232-916e-5c2fd205715e at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa78b124-1e8a-4232-916e-5c2fd205715e', 'metadata': {}}]). {{(pid=87487) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:18:50 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Image download 0.00 MB at 0.00 MB/s Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6447e91-3e02-48ac-9d9e-78b6cc51734e]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:50 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:51 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD Jul 21 19:18:51 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:51 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD Jul 21 19:18:51 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:51 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9 1073741824" returned: 0 in 0.524s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:51 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9 Jul 21 19:18:51 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:51 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:51 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:51 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD Jul 21 19:18:51 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:51 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9" returned: 0 in 0.252s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.138s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1641842230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18aa025a-7cea-4baa-b648-16385fa0c559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095aae74caa543d4aaa190c098640315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:50Z,use_quota=True,user_id='bfcee1d95a5d413592611c5474b190d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Creating volume 18aa025a-7cea-4baa-b648-16385fa0c559 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:51 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18aa025a-7cea-4baa-b648-16385fa0c559 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:51 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18aa025a-7cea-4baa-b648-16385fa0c559 1073741824 Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d5fbe9-f518-4aa1-8da5-180b83fb5abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:51 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b641b0cf-9f8f-4b7c-80da-0c8d85ea6206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:51 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9 (08510f46-9d44-4aef-b8ca-ac47ed851ce9): created successfully Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b641b0cf-9f8f-4b7c-80da-0c8d85ea6206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Flow 'volume_create_manager' (307b117b-a1b7-44d7-85b8-bf06ca782c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:51 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-059d7fa0-b495-41ec-9077-f09423975289 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Created volume successfully. Jul 21 19:18:51 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Temporary image fa78b124-1e8a-4232-916e-5c2fd205715e is fetched for user afafcb436ed746a39b6aaaae806f4aae. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d27f26-1d1e-4297-b89a-24f5897f2af3]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:51 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD Jul 21 19:18:51 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:51 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18aa025a-7cea-4baa-b648-16385fa0c559 1073741824" returned: 0 in 0.487s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18aa025a-7cea-4baa-b648-16385fa0c559 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:51 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18aa025a-7cea-4baa-b648-16385fa0c559 Jul 21 19:18:51 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:52 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:52 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD Jul 21 19:18:52 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:52 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18aa025a-7cea-4baa-b648-16385fa0c559" returned: 0 in 0.247s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.906s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa4b5d2-7459-42db-bf99-6a0e18a42bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18aa025a-7cea-4baa-b648-16385fa0c559', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c54fb3-5d47-46c5-92f8-f85a343ff2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] Creating offline snapshot b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 of volume 209f3516-c816-4806-803f-6c359fbb384d {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:18:52 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume volume-18aa025a-7cea-4baa-b648-16385fa0c559 (18aa025a-7cea-4baa-b648-16385fa0c559): created successfully Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c54fb3-5d47-46c5-92f8-f85a343ff2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Flow 'volume_create_manager' (80e510c5-4505-47cd-b8db-403c4a3ae137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a6904d-347e-4c85-9572-c09abc8862b1]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:52 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-32149fc1-c773-4767-be10-5166468e985f tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Created volume successfully. Jul 21 19:18:52 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d Jul 21 19:18:52 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:52 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:52 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d" returned: 0 in 0.373s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:52 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 1G Jul 21 19:18:52 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:53 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 1G" returned: 0 in 0.387s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209f3516-c816-4806-803f-6c359fbb384d -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:53 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209f3516-c816-4806-803f-6c359fbb384d -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 Jul 21 19:18:53 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:53 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209f3516-c816-4806-803f-6c359fbb384d -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86" returned: 0 in 0.268s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:53 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 is being set with open permissions: ugo+rw Jul 21 19:18:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:53 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 Jul 21 19:18:53 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:53 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86" returned: 0 in 0.246s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:53 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.info Jul 21 19:18:53 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:53 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.info" returned: 0 in 0.269s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:53 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.info is being set with open permissions: ugo+rw Jul 21 19:18:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:53 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.info Jul 21 19:18:53 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:54 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.info" returned: 0 in 0.251s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.599s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1264847492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76cbf07e-588d-4566-a667-e4559b632c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095aae74caa543d4aaa190c098640315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:50Z,use_quota=True,user_id='bfcee1d95a5d413592611c5474b190d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Creating volume 76cbf07e-588d-4566-a667-e4559b632c91 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:54 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-76cbf07e-588d-4566-a667-e4559b632c91 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:54 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-76cbf07e-588d-4566-a667-e4559b632c91 1073741824 Jul 21 19:18:54 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:54 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b9149bbf-9cc3-4ec2-9af2-1fdfa2d2b40a tempest-VolumeDependencyTests-1591925916 None] Create snapshot completed successfully Jul 21 19:18:54 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-76cbf07e-588d-4566-a667-e4559b632c91 1073741824" returned: 0 in 0.425s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-76cbf07e-588d-4566-a667-e4559b632c91 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:54 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-76cbf07e-588d-4566-a667-e4559b632c91 Jul 21 19:18:54 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:54 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-76cbf07e-588d-4566-a667-e4559b632c91" returned: 0 in 0.276s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.602s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cbbcfd-7248-43bc-be8e-77a22d7961dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c4fba9f622f4c6c938e5242d4972d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:49Z,use_quota=True,user_id='cc1eeff0346a4013860f85c2145802d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Creating volume 69cbbcfd-7248-43bc-be8e-77a22d7961dd {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:54 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e51798b-c63c-4745-87dd-291f76a40613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76cbf07e-588d-4566-a667-e4559b632c91', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:54 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd 1073741824 Jul 21 19:18:54 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc042235-9ee9-4265-88bf-6b6538dc979a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:54 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Volume volume-76cbf07e-588d-4566-a667-e4559b632c91 (76cbf07e-588d-4566-a667-e4559b632c91): created successfully Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc042235-9ee9-4265-88bf-6b6538dc979a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:54 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Flow 'volume_create_manager' (48079af6-88a0-41ac-9c58-5a34dc945222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:54 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-cadfb804-3568-414a-bbc2-c880748bde20 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Created volume successfully. Jul 21 19:18:55 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd 1073741824" returned: 0 in 0.432s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:55 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd Jul 21 19:18:55 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Flow 'volume_create_manager' (59b8f4df-74b9-452b-835b-809c0d25d566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e73403-bb76-4a68-9905-5515558c27a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e73403-bb76-4a68-9905-5515558c27a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-315968421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea20f5a5-824b-48eb-abe1-4e6d3695b777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977148c79cf142288fadbfd059edf1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b4a2d9b1-feaa-4270-8485-2ff9eb62ef86,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:55Z,use_quota=True,user_id='858491de1a3e4d50ab5a483ebdaf130f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3592c107-1961-412e-8fa7-3963bcfa663a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3592c107-1961-412e-8fa7-3963bcfa663a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:55 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f976c71e-fb4b-410c-8840-14454930e288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f976c71e-fb4b-410c-8840-14454930e288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea20f5a5-824b-48eb-abe1-4e6d3695b777', 'volume_name': 'volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777', 'volume_size': 1, 'snapshot_id': 'b4a2d9b1-feaa-4270-8485-2ff9eb62ef86'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e212d130-ac8d-4ff2-8038-c886b08f3426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e212d130-ac8d-4ff2-8038-c886b08f3426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d2db20-407c-453e-a19c-4269a6098dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:55 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Volume ea20f5a5-824b-48eb-abe1-4e6d3695b777: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777', 'volume_size': 1, 'snapshot_id': 'b4a2d9b1-feaa-4270-8485-2ff9eb62ef86'} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd" returned: 0 in 0.284s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.265s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2fa75d5-ff6b-4b70-8c24-c33624be9ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ef8f5dea734f92a65b001434cb5605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:50Z,use_quota=True,user_id='afafcb436ed746a39b6aaaae806f4aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29e61c58-5cb6-4f82-8e2b-83383a5cd486),volume_type_id=29e61c58-5cb6-4f82-8e2b-83383a5cd486)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Creating volume b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:55 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:55 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 1073741824 Jul 21 19:18:55 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Attempting download of 045bb393-ce54-401d-a0b2-07d559c415b4 ((None, [{'url': 'file:///opt/stack/data/glance/images/045bb393-ce54-401d-a0b2-07d559c415b4', 'metadata': {}}])) to volume 69cbbcfd-7248-43bc-be8e-77a22d7961dd. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcef03d-8906-43d5-9773-0658baefab48]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_045bb393-ce54-401d-a0b2-07d559c415b4_eb8x70l7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "cinder-76cbf07e-588d-4566-a667-e4559b632c91-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-76cbf07e-588d-4566-a667-e4559b632c91-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "cinder-quobyte-76cbf07e-588d-4566-a667-e4559b632c91" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-quobyte-76cbf07e-588d-4566-a667-e4559b632c91" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ce43e5-c79a-4113-aaaf-ee890ba15e33]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-76cbf07e-588d-4566-a667-e4559b632c91 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:55 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_045bb393-ce54-401d-a0b2-07d559c415b4_eb8x70l7 Jul 21 19:18:55 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:56 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-76cbf07e-588d-4566-a667-e4559b632c91 Jul 21 19:18:56 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:56 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:56 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_045bb393-ce54-401d-a0b2-07d559c415b4_eb8x70l7" returned: 0 in 0.415s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_045bb393-ce54-401d-a0b2-07d559c415b4_eb8x70l7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 1073741824" returned: 0 in 0.550s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:56 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 Jul 21 19:18:56 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:56 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_045bb393-ce54-401d-a0b2-07d559c415b4_eb8x70l7 Jul 21 19:18:56 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:56 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-76cbf07e-588d-4566-a667-e4559b632c91" returned: 0 in 0.400s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-76cbf07e-588d-4566-a667-e4559b632c91 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:56 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-76cbf07e-588d-4566-a667-e4559b632c91 Jul 21 19:18:56 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:56 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1" returned: 0 in 0.251s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.830s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "cinder-quobyte-b4a2d9b1-feaa-4270-8485-2ff9eb62ef86-ea20f5a5-824b-48eb-abe1-4e6d3695b777" by "_create_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-quobyte-b4a2d9b1-feaa-4270-8485-2ff9eb62ef86-ea20f5a5-824b-48eb-abe1-4e6d3695b777" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Creating volume ea20f5a5-824b-48eb-abe1-4e6d3695b777 from snapshot b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 {{(pid=87487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "cinder-quobyte-ea20f5a5-824b-48eb-abe1-4e6d3695b777" by "_copy_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Attempting download of fa78b124-1e8a-4232-916e-5c2fd205715e ((None, [{'url': 'file:///opt/stack/data/glance/images/fa78b124-1e8a-4232-916e-5c2fd205715e', 'metadata': {}}])) to volume b2fa75d5-ff6b-4b70-8c24-c33624be9ce1. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-quobyte-ea20f5a5-824b-48eb-abe1-4e6d3695b777" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] snapshot: b4a2d9b1-feaa-4270-8485-2ff9eb62ef86, volume: ea20f5a5-824b-48eb-abe1-4e6d3695b777, {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:18:56 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_045bb393-ce54-401d-a0b2-07d559c415b4_eb8x70l7" returned: 1 in 0.419s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:56 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_045bb393-ce54-401d-a0b2-07d559c415b4_eb8x70l7' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-76cbf07e-588d-4566-a667-e4559b632c91" returned: 0 in 0.270s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb21061-faa1-48d2-b187-e4338411fb51]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc92f13e-adea-4016-ba69-5266940b7e87]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e695e08-0f2b-4f3b-b3a7-28379186cfef]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa78b124-1e8a-4232-916e-5c2fd205715e_y6gzzugu {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-quobyte-76cbf07e-588d-4566-a667-e4559b632c91" released by "delete_volume" :: held 0.749s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Created reservations ['0d28922b-0f38-4b0d-a989-c3d1acfde482', '45ed5c24-6b43-488e-a8c6-13fa890abac1', '11210a12-92ac-4e5a-ae9b-5c194bc4013c', '184c54af-1f2a-48b0-aa83-8606d7922e01'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:56 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD Jul 21 19:18:56 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:56 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 Jul 21 19:18:56 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:56 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa78b124-1e8a-4232-916e-5c2fd205715e_y6gzzugu Jul 21 19:18:56 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:56 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:56 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:56 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:57 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.256s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:57 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Deleted volume successfully. Jul 21 19:18:57 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "cinder-18aa025a-7cea-4baa-b648-16385fa0c559-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86" returned: 0 in 0.479s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-209f3516-c816-4806-803f-6c359fbb384d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Creating direct copy from snapshot {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:18:57 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD Jul 21 19:18:57 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-18aa025a-7cea-4baa-b648-16385fa0c559-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0cd49d68-bfb6-464c-8244-64e3d2b40d5e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-76cbf07e-588d-4566-a667-e4559b632c91-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f424e6-1a94-4b5a-bef1-73ace218e812]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:57 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa78b124-1e8a-4232-916e-5c2fd205715e_y6gzzugu" returned: 0 in 0.559s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa78b124-1e8a-4232-916e-5c2fd205715e_y6gzzugu {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "cinder-quobyte-18aa025a-7cea-4baa-b648-16385fa0c559" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-quobyte-18aa025a-7cea-4baa-b648-16385fa0c559" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a862a4a-b92d-4974-8ffd-241a2c6694a8]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18aa025a-7cea-4baa-b648-16385fa0c559 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:57 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d Jul 21 19:18:57 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:57 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa78b124-1e8a-4232-916e-5c2fd205715e_y6gzzugu Jul 21 19:18:57 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:57 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD" returned: 1 in 0.416s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] 045bb393-ce54-401d-a0b2-07d559c415b4 was raw, converting to qcow2 {{(pid=87487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:18:57 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18aa025a-7cea-4baa-b648-16385fa0c559 Jul 21 19:18:57 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:57 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd Jul 21 19:18:57 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:57 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d" returned: 0 in 0.402s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG cinder.utils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Path /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777 not found in is_blk_device check {{(pid=87487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:57 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa78b124-1e8a-4232-916e-5c2fd205715e_y6gzzugu" returned: 1 in 0.377s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa78b124-1e8a-4232-916e-5c2fd205715e_y6gzzugu' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc34eae-6826-4c79-bf5f-e2293bcbcf57]: (4, 'raw') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:57 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777 Jul 21 19:18:57 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:57 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18aa025a-7cea-4baa-b648-16385fa0c559" returned: 0 in 0.405s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18aa025a-7cea-4baa-b648-16385fa0c559 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:57 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD Jul 21 19:18:57 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:57 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18aa025a-7cea-4baa-b648-16385fa0c559 Jul 21 19:18:57 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:57 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd" returned: 0 in 0.517s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_045bb393-ce54-401d-a0b2-07d559c415b4_uxrcixbhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:18:57 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:57 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:57 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd 1G Jul 21 19:18:57 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:58 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18aa025a-7cea-4baa-b648-16385fa0c559" returned: 0 in 0.315s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-quobyte-18aa025a-7cea-4baa-b648-16385fa0c559" released by "delete_volume" :: held 0.763s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Created reservations ['ef54ffbc-2d23-4f0a-b1da-f8d03ffb7e99', '2c12ac88-de9f-4aa2-91ad-5c152af437a7', '3b79f9e5-17f7-464c-b8df-01a7bed6d11f', 'df3a4883-ad7c-4566-b038-5898860dbbc1'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:58 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD Jul 21 19:18:58 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:58 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:18:58 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:58 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD" returned: 1 in 0.649s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] fa78b124-1e8a-4232-916e-5c2fd205715e was raw, converting to qcow2 {{(pid=87487) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:58 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 Jul 21 19:18:58 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:58 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd 1G" returned: 0 in 0.967s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Downloaded image 045bb393-ce54-401d-a0b2-07d559c415b4 ((None, [{'url': 'file:///opt/stack/data/glance/images/045bb393-ce54-401d-a0b2-07d559c415b4', 'metadata': {}}])) to volume 69cbbcfd-7248-43bc-be8e-77a22d7961dd successfully. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Temporary image 045bb393-ce54-401d-a0b2-07d559c415b4 for user cc1eeff0346a4013860f85c2145802d6 is deleted. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Marking volume 69cbbcfd-7248-43bc-be8e-77a22d7961dd as bootable. {{(pid=87487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Copying metadata from image 045bb393-ce54-401d-a0b2-07d559c415b4 to 69cbbcfd-7248-43bc-be8e-77a22d7961dd. {{(pid=87487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:18:58 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Creating volume glance metadata for volume 69cbbcfd-7248-43bc-be8e-77a22d7961dd backed by image 045bb393-ce54-401d-a0b2-07d559c415b4 with: {'image_id': '045bb393-ce54-401d-a0b2-07d559c415b4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7b9d6704d9bf0a4f2be7c5030c644ed5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:18:58 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.593s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:59 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Deleted volume successfully. Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-787f137e-82f4-4dc8-9fcd-4ee69999c731 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-18aa025a-7cea-4baa-b648-16385fa0c559-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b713a18-3e8a-4723-95a8-1deeb6d3e489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd', 'volume_size': 1, 'image_id': '045bb393-ce54-401d-a0b2-07d559c415b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/045bb393-ce54-401d-a0b2-07d559c415b4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7b9d6704d9bf0a4f2be7c5030c644ed5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4c4fba9f622f4c6c938e5242d4972d49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e5d64aef06bab9e7f42a8bde2c82d4d5e7822f3d4ea829456acd2918ce08094ffdaea160f8b696df2434843946a37af4b17ce121b7775b4919da0b3e7bf78d59', 'id': '045bb393-ce54-401d-a0b2-07d559c415b4', 'created_at': datetime.datetime(2026, 7, 21, 17, 18, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 18, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/045bb393-ce54-401d-a0b2-07d559c415b4/file', 'properties': {}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41bcf72-8293-4cfb-91a2-569c57a1b801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:59 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Volume volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd (69cbbcfd-7248-43bc-be8e-77a22d7961dd): created successfully Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41bcf72-8293-4cfb-91a2-569c57a1b801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Flow 'volume_create_manager' (1ce89a3f-6e62-4076-a1c7-0fa1d5c483f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:59 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-12dc3ec7-2973-4e1e-88e6-04225d36a354 tempest-VolumeImageDependencyTests-1237998857 None] Created volume successfully. Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "cinder-08510f46-9d44-4aef-b8ca-ac47ed851ce9-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-08510f46-9d44-4aef-b8ca-ac47ed851ce9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "cinder-quobyte-08510f46-9d44-4aef-b8ca-ac47ed851ce9" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-quobyte-08510f46-9d44-4aef-b8ca-ac47ed851ce9" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8f3cce-8bce-4feb-b61e-f2d4439aae22]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:59 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1" returned: 0 in 1.171s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa78b124-1e8a-4232-916e-5c2fd205715e_09zf0e9ldevstack@QuobyteHD, size 0.00 MB, duration 1.18 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:18:59 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 19:18:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:59 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 1G Jul 21 19:18:59 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:59 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9 Jul 21 19:18:59 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:00 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9" returned: 0 in 0.689s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:00 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9 Jul 21 19:19:00 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:00 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 1G" returned: 0 in 0.793s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Downloaded image fa78b124-1e8a-4232-916e-5c2fd205715e ((None, [{'url': 'file:///opt/stack/data/glance/images/fa78b124-1e8a-4232-916e-5c2fd205715e', 'metadata': {}}])) to volume b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 successfully. {{(pid=87487) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Temporary image fa78b124-1e8a-4232-916e-5c2fd205715e for user afafcb436ed746a39b6aaaae806f4aae is deleted. {{(pid=87487) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG cinder.volume.volume_utils [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Marking volume b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 as bootable. {{(pid=87487) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Copying metadata from image fa78b124-1e8a-4232-916e-5c2fd205715e to b2fa75d5-ff6b-4b70-8c24-c33624be9ce1. {{(pid=87487) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Creating volume glance metadata for volume b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 backed by image fa78b124-1e8a-4232-916e-5c2fd205715e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fa78b124-1e8a-4232-916e-5c2fd205715e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7a638586ddbbe6a7febb032fb69c894a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87487) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Acquiring lock "cinder-69cbbcfd-7248-43bc-be8e-77a22d7961dd-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Lock "cinder-69cbbcfd-7248-43bc-be8e-77a22d7961dd-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Acquiring lock "cinder-quobyte-69cbbcfd-7248-43bc-be8e-77a22d7961dd" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f056fa3-8684-4027-96c7-2a07685d01b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1', 'volume_size': 1, 'image_id': 'fa78b124-1e8a-4232-916e-5c2fd205715e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa78b124-1e8a-4232-916e-5c2fd205715e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7a638586ddbbe6a7febb032fb69c894a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4ef8f5dea734f92a65b001434cb5605', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16a6d6aacf5b6fe91461eec32cba3986e7f86042141037d057d6c9a5b61abcb949a27a2196bce568b5d33efb2676619dfc4e77b8f1f271988a5337b3445ed672', 'id': 'fa78b124-1e8a-4232-916e-5c2fd205715e', 'created_at': datetime.datetime(2026, 7, 21, 17, 18, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 18, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa78b124-1e8a-4232-916e-5c2fd205715e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6000b3-f79b-4152-b79a-b215a5a01d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Lock "cinder-quobyte-69cbbcfd-7248-43bc-be8e-77a22d7961dd" acquired by "delete_volume" :: waited 0.045s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:00 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Volume volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 (b2fa75d5-ff6b-4b70-8c24-c33624be9ce1): created successfully Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6000b3-f79b-4152-b79a-b215a5a01d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Flow 'volume_create_manager' (6ccb17f5-c013-46f7-90e0-f148cdb1b9dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:00 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-08510f46-9d44-4aef-b8ca-ac47ed851ce9" returned: 0 in 0.564s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b401691-21b6-4dc0-857e-272483710e9c]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:00 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-060e3e9c-a297-4ccf-a6e7-16e04d5ccd39 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Created volume successfully. Jul 21 19:19:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:01 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-quobyte-08510f46-9d44-4aef-b8ca-ac47ed851ce9" released by "delete_volume" :: held 1.400s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:01 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Created reservations ['1acb2a99-3fd6-4ade-8ee0-e0d1977e14d9', '32d494d5-8fc5-4f9f-8c57-bddac4289ccc', '11c21c5f-787a-4f8e-b149-7990ca3e5c10', '176acb9b-0c9d-4055-9fc1-a297ee937904'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:01 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd Jul 21 19:19:01 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:01 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:01 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:01 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd" returned: 0 in 0.789s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:01 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd Jul 21 19:19:01 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:02 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.678s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:02 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Deleted volume successfully. Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b908938d-bd26-4e9b-8224-93ac9b475c5c tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-08510f46-9d44-4aef-b8ca-ac47ed851ce9-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Acquiring lock "cinder-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "cinder-3e997fda-55a7-4ba6-ae47-94ee0ccba180-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Lock "cinder-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-3e997fda-55a7-4ba6-ae47-94ee0ccba180-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Acquiring lock "cinder-quobyte-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Lock "cinder-quobyte-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1" acquired by "delete_volume" :: waited 0.035s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "cinder-quobyte-3e997fda-55a7-4ba6-ae47-94ee0ccba180" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b8a4ac-ba9d-4720-8c51-7d817c0796bc]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-quobyte-3e997fda-55a7-4ba6-ae47-94ee0ccba180" acquired by "delete_volume" :: waited 0.042s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:02 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-69cbbcfd-7248-43bc-be8e-77a22d7961dd" returned: 0 in 0.924s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c18757-aa9e-4449-b8e1-6c484e6a7df8]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Lock "cinder-quobyte-69cbbcfd-7248-43bc-be8e-77a22d7961dd" released by "delete_volume" :: held 1.908s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:02 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 Jul 21 19:19:02 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:02 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180 Jul 21 19:19:02 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:02 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Created reservations ['7e8a60b8-4aaf-4201-a4cf-a8a1fad083fc', '04154600-1d4d-463e-afb0-e0fe4a19e1fe', '8edd8786-fc59-4569-a09d-acdaeddcb0d7', 'ef0ccf66-8b33-4705-a578-207ab04a7e73'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:03 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777" returned: 0 in 5.640s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:03 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:03 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c03f43-bd2a-45f1-ba36-ddf1bef006c6]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:03 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180" returned: 0 in 0.625s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:03 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d Jul 21 19:19:03 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:03 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180 Jul 21 19:19:03 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:03 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1" returned: 0 in 0.780s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:03 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1 Jul 21 19:19:03 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:03 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.355s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:03 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Deleted volume successfully. Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-b67ff263-c2ec-4ad1-a940-694115dbc4cd tempest-VolumeImageDependencyTests-1237998857 None] Lock "cinder-69cbbcfd-7248-43bc-be8e-77a22d7961dd-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:03 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3e997fda-55a7-4ba6-ae47-94ee0ccba180" returned: 0 in 0.443s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:03 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1" returned: 0 in 0.397s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-quobyte-3e997fda-55a7-4ba6-ae47-94ee0ccba180" released by "delete_volume" :: held 1.149s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Lock "cinder-quobyte-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1" released by "delete_volume" :: held 1.280s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Created reservations ['0004b0f8-b3b2-4fe2-a837-40221f45a55a', '42c39e0b-bbb2-433e-8daf-0ab8cdb4601b', 'b22be042-c98f-414b-9682-072c719fce75', '86eb11c8-299a-4a80-9b64-46a9e14ee626'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Created reservations ['ed8d8be5-5546-454c-993d-f2407c3fd490', '4c23cbd7-e537-4a7b-94b0-0bf9c3fb5969', 'b463fee6-eeee-4368-9b66-7ad253fd4758', '0ac1b8f4-b8d7-4ef5-b53d-4bcbf3835091'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:03 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d" returned: 0 in 0.711s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:19:03 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Converted 1024.00 MB image at 181.51 MB/s Jul 21 19:19:03 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777 is being set with open permissions: ugo+rw Jul 21 19:19:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:03 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777 Jul 21 19:19:03 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:04 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:04 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:04 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777" returned: 0 in 0.268s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:04 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:04 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-quobyte-ea20f5a5-824b-48eb-abe1-4e6d3695b777" released by "_copy_volume_from_snapshot" :: held 7.670s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-quobyte-b4a2d9b1-feaa-4270-8485-2ff9eb62ef86-ea20f5a5-824b-48eb-abe1-4e6d3695b777" released by "_create_volume_from_snapshot" :: held 7.715s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.742s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d2db20-407c-453e-a19c-4269a6098dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777', 'volume_size': 1, 'snapshot_id': 'b4a2d9b1-feaa-4270-8485-2ff9eb62ef86'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27109e61-85fe-40f2-aca7-37a76db6ec00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:04 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Volume volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777 (ea20f5a5-824b-48eb-abe1-4e6d3695b777): created successfully Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27109e61-85fe-40f2-aca7-37a76db6ec00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Flow 'volume_create_manager' (59b8f4df-74b9-452b-835b-809c0d25d566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:04 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.275s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:04 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Deleted volume successfully. Jul 21 19:19:04 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9c7fb2a0-9bbb-4863-8fbf-ff77ca7a6b1e tempest-VolumeDependencyTests-1591925916 None] Created volume successfully. Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-58dee797-f5ab-454b-bf7f-60261608b3a9 tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-3e997fda-55a7-4ba6-ae47-94ee0ccba180-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:04 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.287s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:04 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Deleted volume successfully. Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2c8f6e7c-c708-408d-b01e-4b078736afc3 tempest-VolumeAndVolumeTypeFromImageTest-631990260 None] Lock "cinder-b2fa75d5-ff6b-4b70-8c24-c33624be9ce1-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "cinder-b4a2d9b1-feaa-4270-8485-2ff9eb62ef86-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-b4a2d9b1-feaa-4270-8485-2ff9eb62ef86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "cinder-quobyte-209f3516-c816-4806-803f-6c359fbb384d" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-quobyte-209f3516-c816-4806-803f-6c359fbb384d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "cinder-quobyte-b4a2d9b1-feaa-4270-8485-2ff9eb62ef86" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-quobyte-b4a2d9b1-feaa-4270-8485-2ff9eb62ef86" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Deleting offline snapshot b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 of volume 209f3516-c816-4806-803f-6c359fbb384d {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] snapshot_file for this snap is: volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aab65c3-0afd-4a38-91e2-457d3ad88738]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "cinder-998a376a-dc15-42b5-b067-14ecc0e68b3c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-998a376a-dc15-42b5-b067-14ecc0e68b3c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "cinder-quobyte-998a376a-dc15-42b5-b067-14ecc0e68b3c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-quobyte-998a376a-dc15-42b5-b067-14ecc0e68b3c" acquired by "delete_volume" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[799ed0eb-c160-403c-9505-8dfa97ab0be6]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-998a376a-dc15-42b5-b067-14ecc0e68b3c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:04 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 Jul 21 19:19:04 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:05 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-998a376a-dc15-42b5-b067-14ecc0e68b3c Jul 21 19:19:05 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:05 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86" returned: 0 in 0.521s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-209f3516-c816-4806-803f-6c359fbb384d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:05 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7784ca-f762-481a-b8a2-8b24373d039d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:05 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-998a376a-dc15-42b5-b067-14ecc0e68b3c" returned: 0 in 0.480s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-998a376a-dc15-42b5-b067-14ecc0e68b3c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:05 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d Jul 21 19:19:05 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:05 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-998a376a-dc15-42b5-b067-14ecc0e68b3c Jul 21 19:19:05 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:05 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-998a376a-dc15-42b5-b067-14ecc0e68b3c" returned: 0 in 0.339s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:05 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d" returned: 0 in 0.447s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-quobyte-998a376a-dc15-42b5-b067-14ecc0e68b3c" released by "delete_volume" :: held 0.879s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:05 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 Jul 21 19:19:05 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:05 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Created reservations ['49e5450f-280a-4a09-94ed-603c07d0a753', '8befc574-9685-4ccf-83f0-cee699e11b35', '0cfab2f7-c230-4fe1-9af8-4b49097a4e71', '6c2dc286-4270-447f-a2cd-be5190f27f4d'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:06 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:06 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:06 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86" returned: 0 in 0.452s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:06 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86 Jul 21 19:19:06 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:06 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.280s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:06 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Deleted volume successfully. Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ad631160-aac4-4baa-bd11-21c31ff88d1e tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-998a376a-dc15-42b5-b067-14ecc0e68b3c-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:06 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d.b4a2d9b1-feaa-4270-8485-2ff9eb62ef86" returned: 0 in 0.291s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-quobyte-b4a2d9b1-feaa-4270-8485-2ff9eb62ef86" released by "_delete_snapshot" :: held 1.838s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-quobyte-209f3516-c816-4806-803f-6c359fbb384d" released by "delete_snapshot" :: held 1.874s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Created reservations ['c79f02cb-83e0-4bfe-8298-0abd32c5b4e1', 'c3819969-467d-4a17-aaca-adbd670069d3', '7dd439ea-74a4-4293-9def-88117e730d87', '924fd0ad-98e5-4608-bb72-a5a12ff9275d'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:06 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Delete snapshot completed successfully. Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-81401e94-2e28-4d86-beac-cb493dbf78f0 tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-b4a2d9b1-feaa-4270-8485-2ff9eb62ef86-delete_snapshot" released by "delete_snapshot" :: held 2.047s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "cinder-209f3516-c816-4806-803f-6c359fbb384d-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-209f3516-c816-4806-803f-6c359fbb384d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "cinder-quobyte-209f3516-c816-4806-803f-6c359fbb384d" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-quobyte-209f3516-c816-4806-803f-6c359fbb384d" acquired by "delete_volume" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c7f085-0cf0-4385-91ec-d17857bee4a6]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "cinder-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:07 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d Jul 21 19:19:07 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "cinder-quobyte-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-quobyte-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:07 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d441d9b3-b0c4-4d66-a898-8ff839e6aac9]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:07 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1 Jul 21 19:19:07 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:07 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d" returned: 0 in 0.483s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:07 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d Jul 21 19:19:07 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:07 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1" returned: 0 in 0.438s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:07 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1 Jul 21 19:19:07 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:07 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-209f3516-c816-4806-803f-6c359fbb384d" returned: 0 in 0.350s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-quobyte-209f3516-c816-4806-803f-6c359fbb384d" released by "delete_volume" :: held 0.942s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:07 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Created reservations ['61787d96-fab7-4b13-9e59-df9f965eab0b', '7cedf83f-a793-4df7-a4e3-c855fa6d9469', '06333f23-bc7a-40cc-90a4-17d6f18f2a50', '38ba4e50-7047-4950-9a68-67f2de615186'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:08 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:08 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "cinder-ea20f5a5-824b-48eb-abe1-4e6d3695b777-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-ea20f5a5-824b-48eb-abe1-4e6d3695b777-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "cinder-quobyte-ea20f5a5-824b-48eb-abe1-4e6d3695b777" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-quobyte-ea20f5a5-824b-48eb-abe1-4e6d3695b777" acquired by "delete_volume" :: waited 0.031s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:08 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1" returned: 0 in 0.578s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3315f73e-57ac-4b2f-95a7-1d1249a76f6e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-quobyte-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1" released by "delete_volume" :: held 1.107s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Created reservations ['819c2bb3-da70-4a9d-a152-83ac3c70eef7', '540a42d7-f200-432a-b95d-5f129c15aab5', '57007d12-3b4a-4ec8-8530-f08fbed5d9bd', '20783342-6549-4c25-b1d1-363aec97e079'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:08 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.353s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:08 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Deleted volume successfully. Jul 21 19:19:08 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777 Jul 21 19:19:08 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-379ccf78-eb39-4525-873c-3a524199c9fd tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-209f3516-c816-4806-803f-6c359fbb384d-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:08 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:08 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:08 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777" returned: 0 in 0.502s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:08 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777 Jul 21 19:19:08 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:08 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.341s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:08 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Deleted volume successfully. Jul 21 19:19:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-578501a4-b9d0-4e35-a4f6-1c6d9222c38d tempest-CreateVolumesFromSourceVolumeTest-2045143396 None] Lock "cinder-6cd3ecb0-c470-4cf9-8f57-3bb3ad07dac1-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:09 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-ea20f5a5-824b-48eb-abe1-4e6d3695b777" returned: 0 in 0.278s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-quobyte-ea20f5a5-824b-48eb-abe1-4e6d3695b777" released by "delete_volume" :: held 0.860s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:09 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Created reservations ['4bc27796-5f84-4154-945a-7f813f1e6fa7', 'a41708df-3d37-45aa-b3bb-ef0dcce8811f', 'ed4caba5-6c1a-4824-9ba1-70322aca93e2', 'e6d2d989-1340-4367-be47-4c1e3e53a59c'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:09 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:09 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:09 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.273s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:09 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:09 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Deleted volume successfully. Jul 21 19:19:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-91c37093-d444-4c8a-b123-27492c9f041b tempest-VolumeDependencyTests-1591925916 None] Lock "cinder-ea20f5a5-824b-48eb-abe1-4e6d3695b777-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Flow 'volume_create_manager' (6a655c33-a194-4f97-beb1-b037e252c10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f0c3c3-68ee-4047-8539-f334309641d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f0c3c3-68ee-4047-8539-f334309641d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1796325897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcecba1-10db-483c-9ec7-1705d8103a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203d6f6b90fa493a99c397894213c997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:11Z,use_quota=True,user_id='d290606543014fb1899a2a82fc47d740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dd722b-f245-470e-8398-bc6e226499d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dd722b-f245-470e-8398-bc6e226499d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35588ee8-b710-43e4-989d-e39b338f7b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35588ee8-b710-43e4-989d-e39b338f7b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dcecba1-10db-483c-9ec7-1705d8103a8b', 'volume_name': 'volume-4dcecba1-10db-483c-9ec7-1705d8103a8b', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c062e906-b347-4aa3-b715-52e15066815b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c062e906-b347-4aa3-b715-52e15066815b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff092521-df10-40c4-ae34-e3f2808ebf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:11 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Volume 4dcecba1-10db-483c-9ec7-1705d8103a8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dcecba1-10db-483c-9ec7-1705d8103a8b', 'volume_size': 1} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1796325897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcecba1-10db-483c-9ec7-1705d8103a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203d6f6b90fa493a99c397894213c997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:11Z,use_quota=True,user_id='d290606543014fb1899a2a82fc47d740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Creating volume 4dcecba1-10db-483c-9ec7-1705d8103a8b {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:11 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4dcecba1-10db-483c-9ec7-1705d8103a8b 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:11 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4dcecba1-10db-483c-9ec7-1705d8103a8b 1073741824 Jul 21 19:19:11 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Flow 'volume_create_manager' (fac21145-9f42-414a-abc5-03d039f24bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10bc8c79-67ba-4ef5-8c7b-7611677b26fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10bc8c79-67ba-4ef5-8c7b-7611677b26fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1452288112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235249ec-7699-4a08-8e3f-e654dc0c9f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203d6f6b90fa493a99c397894213c997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:12Z,use_quota=True,user_id='d290606543014fb1899a2a82fc47d740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:12 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a86770-198a-47b3-963f-db3282365e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a86770-198a-47b3-963f-db3282365e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9f6c96-5c91-4df2-bfb0-b07efde52149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9f6c96-5c91-4df2-bfb0-b07efde52149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '235249ec-7699-4a08-8e3f-e654dc0c9f24', 'volume_name': 'volume-235249ec-7699-4a08-8e3f-e654dc0c9f24', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294072f9-2528-41bf-81e2-7655557abeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294072f9-2528-41bf-81e2-7655557abeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3c557d-bb44-4fde-bda5-fc6603e03834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:12 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Volume 235249ec-7699-4a08-8e3f-e654dc0c9f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-235249ec-7699-4a08-8e3f-e654dc0c9f24', 'volume_size': 1} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4dcecba1-10db-483c-9ec7-1705d8103a8b 1073741824" returned: 0 in 0.689s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4dcecba1-10db-483c-9ec7-1705d8103a8b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:12 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4dcecba1-10db-483c-9ec7-1705d8103a8b Jul 21 19:19:12 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:12 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4dcecba1-10db-483c-9ec7-1705d8103a8b" returned: 0 in 0.348s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1452288112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235249ec-7699-4a08-8e3f-e654dc0c9f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203d6f6b90fa493a99c397894213c997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:12Z,use_quota=True,user_id='d290606543014fb1899a2a82fc47d740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Creating volume 235249ec-7699-4a08-8e3f-e654dc0c9f24 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:12 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-235249ec-7699-4a08-8e3f-e654dc0c9f24 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff092521-df10-40c4-ae34-e3f2808ebf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dcecba1-10db-483c-9ec7-1705d8103a8b', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:12 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-235249ec-7699-4a08-8e3f-e654dc0c9f24 1073741824 Jul 21 19:19:12 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb7a6f2-f72f-4436-b521-34c2573693b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:12 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Volume volume-4dcecba1-10db-483c-9ec7-1705d8103a8b (4dcecba1-10db-483c-9ec7-1705d8103a8b): created successfully Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb7a6f2-f72f-4436-b521-34c2573693b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:12 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Flow 'volume_create_manager' (6a655c33-a194-4f97-beb1-b037e252c10e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:12 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a691d429-d328-45c8-a7b4-f6da843b723c tempest-CreateVolumesFromImageTest-717929934 None] Created volume successfully. Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Flow 'volume_create_manager' (6cf728cd-b372-46d3-a480-50e8985fb1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce2c342-d15b-4ee5-b08c-df4b7b6ab01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce2c342-d15b-4ee5-b08c-df4b7b6ab01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2097087594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f6a306-7f03-46c0-9e80-ad64a1d6f202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203d6f6b90fa493a99c397894213c997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:13Z,use_quota=True,user_id='d290606543014fb1899a2a82fc47d740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4825704-9bcf-4d76-80c1-105b3daab6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4825704-9bcf-4d76-80c1-105b3daab6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17110866-98fa-4bf0-8e9c-065006776c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17110866-98fa-4bf0-8e9c-065006776c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f6a306-7f03-46c0-9e80-ad64a1d6f202', 'volume_name': 'volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef79939b-555c-4a93-a20c-70a71f1cc5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef79939b-555c-4a93-a20c-70a71f1cc5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf4c992-9f8a-492c-acb6-1010e61226b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:13 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Volume 40f6a306-7f03-46c0-9e80-ad64a1d6f202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202', 'volume_size': 1} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:13 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-235249ec-7699-4a08-8e3f-e654dc0c9f24 1073741824" returned: 0 in 0.630s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-235249ec-7699-4a08-8e3f-e654dc0c9f24 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:13 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-235249ec-7699-4a08-8e3f-e654dc0c9f24 Jul 21 19:19:13 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Flow 'volume_create_manager' (ef04115e-6770-4a84-a851-0973c9183cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65eec6a7-89e9-4504-8cf5-98ca2d5d96cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65eec6a7-89e9-4504-8cf5-98ca2d5d96cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-17133169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e546e2-00b0-43fe-acfa-7bb79f957849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203d6f6b90fa493a99c397894213c997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:14Z,use_quota=True,user_id='d290606543014fb1899a2a82fc47d740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f29d0f-c078-4340-afed-f70ed96587e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f29d0f-c078-4340-afed-f70ed96587e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8833a10a-6373-40f1-b7f2-0acf0b79b4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8833a10a-6373-40f1-b7f2-0acf0b79b4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e546e2-00b0-43fe-acfa-7bb79f957849', 'volume_name': 'volume-39e546e2-00b0-43fe-acfa-7bb79f957849', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7873ee8-e79d-4914-b9b9-39c79735dce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7873ee8-e79d-4914-b9b9-39c79735dce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712d6942-b77e-4ae8-b64d-887d3b74ea97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:13 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Volume 39e546e2-00b0-43fe-acfa-7bb79f957849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e546e2-00b0-43fe-acfa-7bb79f957849', 'volume_size': 1} Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:13 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-235249ec-7699-4a08-8e3f-e654dc0c9f24" returned: 0 in 0.425s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.784s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2097087594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f6a306-7f03-46c0-9e80-ad64a1d6f202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203d6f6b90fa493a99c397894213c997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:13Z,use_quota=True,user_id='d290606543014fb1899a2a82fc47d740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Creating volume 40f6a306-7f03-46c0-9e80-ad64a1d6f202 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:14 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3c557d-bb44-4fde-bda5-fc6603e03834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-235249ec-7699-4a08-8e3f-e654dc0c9f24', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87906b4f-1263-45cb-ac3c-02ba69cc2f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:14 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202 1073741824 Jul 21 19:19:14 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:14 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Volume volume-235249ec-7699-4a08-8e3f-e654dc0c9f24 (235249ec-7699-4a08-8e3f-e654dc0c9f24): created successfully Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87906b4f-1263-45cb-ac3c-02ba69cc2f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Flow 'volume_create_manager' (fac21145-9f42-414a-abc5-03d039f24bc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:14 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4e5c4b39-de39-4a56-9282-894d67860e96 tempest-CreateVolumesFromImageTest-717929934 None] Created volume successfully. Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Flow 'volume_create_manager' (441c283a-705c-4633-8633-6dade578c69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7256f48-7c96-472a-a2f1-00bb84ad7260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7256f48-7c96-472a-a2f1-00bb84ad7260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1634614860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d585ce-8a8a-4dfc-8a93-46006d1da72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203d6f6b90fa493a99c397894213c997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:14Z,use_quota=True,user_id='d290606543014fb1899a2a82fc47d740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0733cbc4-956c-4314-bb46-73a7060cc19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0733cbc4-956c-4314-bb46-73a7060cc19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe9df81-5506-40de-9b4e-6d7b7cc52a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe9df81-5506-40de-9b4e-6d7b7cc52a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56d585ce-8a8a-4dfc-8a93-46006d1da72a', 'volume_name': 'volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f4373c-509a-41d8-8255-62028e3ceb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f4373c-509a-41d8-8255-62028e3ceb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6f16d1-bf0a-46b9-bb7a-ade1577aa7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:14 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Volume 56d585ce-8a8a-4dfc-8a93-46006d1da72a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a', 'volume_size': 1} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:14 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202 1073741824" returned: 0 in 0.615s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:14 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202 Jul 21 19:19:14 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:14 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202" returned: 0 in 0.273s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.152s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-17133169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e546e2-00b0-43fe-acfa-7bb79f957849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203d6f6b90fa493a99c397894213c997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:14Z,use_quota=True,user_id='d290606543014fb1899a2a82fc47d740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Creating volume 39e546e2-00b0-43fe-acfa-7bb79f957849 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:14 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-39e546e2-00b0-43fe-acfa-7bb79f957849 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:14 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf4c992-9f8a-492c-acb6-1010e61226b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349e11ac-486d-45ec-bd85-e597ea7be531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:15 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-39e546e2-00b0-43fe-acfa-7bb79f957849 1073741824 Jul 21 19:19:15 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Volume volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202 (40f6a306-7f03-46c0-9e80-ad64a1d6f202): created successfully Jul 21 19:19:15 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349e11ac-486d-45ec-bd85-e597ea7be531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Flow 'volume_create_manager' (6cf728cd-b372-46d3-a480-50e8985fb1b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:15 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5bbee037-28a6-4550-830d-04daa24861de tempest-CreateVolumesFromImageTest-717929934 None] Created volume successfully. Jul 21 19:19:15 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-39e546e2-00b0-43fe-acfa-7bb79f957849 1073741824" returned: 0 in 0.555s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-39e546e2-00b0-43fe-acfa-7bb79f957849 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:15 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-39e546e2-00b0-43fe-acfa-7bb79f957849 Jul 21 19:19:15 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:15 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-39e546e2-00b0-43fe-acfa-7bb79f957849" returned: 0 in 0.324s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.581s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1634614860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d585ce-8a8a-4dfc-8a93-46006d1da72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203d6f6b90fa493a99c397894213c997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:14Z,use_quota=True,user_id='d290606543014fb1899a2a82fc47d740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Creating volume 56d585ce-8a8a-4dfc-8a93-46006d1da72a {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:15 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712d6942-b77e-4ae8-b64d-887d3b74ea97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e546e2-00b0-43fe-acfa-7bb79f957849', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc33e818-5786-46af-9534-e4c6da4d838b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:15 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a 1073741824 Jul 21 19:19:15 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:16 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Volume volume-39e546e2-00b0-43fe-acfa-7bb79f957849 (39e546e2-00b0-43fe-acfa-7bb79f957849): created successfully Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc33e818-5786-46af-9534-e4c6da4d838b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Flow 'volume_create_manager' (ef04115e-6770-4a84-a851-0973c9183cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:16 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-165a6df9-97a0-4580-a183-26c8698b5f3d tempest-CreateVolumesFromImageTest-717929934 None] Created volume successfully. Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Flow 'volume_create_manager' (9fb5f792-c9ce-4612-acf3-3b1ef632effe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfdc082e-cfe2-454b-8493-a3c193f07ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfdc082e-cfe2-454b-8493-a3c193f07ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e7dd50-4e4b-49e5-a514-31d263fb9c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b6a5a1534643319a4de594f964445e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:16Z,use_quota=True,user_id='e377b14630004b92869907688da89433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9bbddf-b85d-4ab2-a659-8407356b1323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9bbddf-b85d-4ab2-a659-8407356b1323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d58458d-bc3e-4bc9-990b-c77c4b60ff58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d58458d-bc3e-4bc9-990b-c77c4b60ff58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18e7dd50-4e4b-49e5-a514-31d263fb9c6a', 'volume_name': 'volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db211ac3-9d5a-43b7-9868-2ada0d15ae54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db211ac3-9d5a-43b7-9868-2ada0d15ae54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81336c41-9d5f-478d-b679-960b206ae48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:16 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Volume 18e7dd50-4e4b-49e5-a514-31d263fb9c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a', 'volume_size': 1} Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:16 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a 1073741824" returned: 0 in 0.719s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:16 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a Jul 21 19:19:16 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a" returned: 0 in 0.301s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:16 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.376s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e7dd50-4e4b-49e5-a514-31d263fb9c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b6a5a1534643319a4de594f964445e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:16Z,use_quota=True,user_id='e377b14630004b92869907688da89433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Creating volume 18e7dd50-4e4b-49e5-a514-31d263fb9c6a {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:17 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6f16d1-bf0a-46b9-bb7a-ade1577aa7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:17 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a 1073741824 Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343d4baf-a7b7-4486-97a8-d7ce01f75e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:17 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:17 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Volume volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a (56d585ce-8a8a-4dfc-8a93-46006d1da72a): created successfully Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343d4baf-a7b7-4486-97a8-d7ce01f75e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Flow 'volume_create_manager' (441c283a-705c-4633-8633-6dade578c69e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:17 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-fb41c22b-8f0f-4c3e-b68a-dc04a79f5e2e tempest-CreateVolumesFromImageTest-717929934 None] Created volume successfully. Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Flow 'volume_create_manager' (dbde650f-73bb-4076-9ada-e67fee72e60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4e9255-f845-4548-ac1e-c07ba2818fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4e9255-f845-4548-ac1e-c07ba2818fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1220686680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ad63a7-f933-43d7-98a5-27e7ac4e0376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2e62bd788a490b9aa087f427e4e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:17Z,use_quota=True,user_id='93a17471043a4a5c93cc8f57d1fd8b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94ea5ac-6c2b-4a7c-bf0f-ac70959adede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94ea5ac-6c2b-4a7c-bf0f-ac70959adede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96aa9cd-6a5e-4649-a1a6-c12391fdcf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96aa9cd-6a5e-4649-a1a6-c12391fdcf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ad63a7-f933-43d7-98a5-27e7ac4e0376', 'volume_name': 'volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb0c20f-bacd-47fd-8e6e-75ddb3850c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb0c20f-bacd-47fd-8e6e-75ddb3850c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6d85b4-26a7-4f58-9ebd-ab685c217e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:17 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Volume 44ad63a7-f933-43d7-98a5-27e7ac4e0376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376', 'volume_size': 1} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:17 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a 1073741824" returned: 0 in 0.486s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:17 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a Jul 21 19:19:17 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "cinder-56d585ce-8a8a-4dfc-8a93-46006d1da72a-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-56d585ce-8a8a-4dfc-8a93-46006d1da72a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "cinder-quobyte-56d585ce-8a8a-4dfc-8a93-46006d1da72a" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-quobyte-56d585ce-8a8a-4dfc-8a93-46006d1da72a" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:17 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a" returned: 0 in 0.342s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.560s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1220686680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ad63a7-f933-43d7-98a5-27e7ac4e0376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2e62bd788a490b9aa087f427e4e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:17Z,use_quota=True,user_id='93a17471043a4a5c93cc8f57d1fd8b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Creating volume 44ad63a7-f933-43d7-98a5-27e7ac4e0376 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:17 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede08615-5ef0-4077-9466-122c07c01578]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:17 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376 1073741824 Jul 21 19:19:17 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81336c41-9d5f-478d-b679-960b206ae48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:17 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd89f38-b3d3-4601-a9c6-9e1c1643af8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:18 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Volume volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a (18e7dd50-4e4b-49e5-a514-31d263fb9c6a): created successfully Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd89f38-b3d3-4601-a9c6-9e1c1643af8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Flow 'volume_create_manager' (9fb5f792-c9ce-4612-acf3-3b1ef632effe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:18 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d876eec8-9c88-4867-950d-c566f7869cfb tempest-CinderUnicodeTest-678725853 None] Created volume successfully. Jul 21 19:19:18 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a Jul 21 19:19:18 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:18 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a" returned: 0 in 0.469s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:18 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a Jul 21 19:19:18 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:18 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376 1073741824" returned: 0 in 0.561s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:18 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376 Jul 21 19:19:18 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:18 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-56d585ce-8a8a-4dfc-8a93-46006d1da72a" returned: 0 in 0.344s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-quobyte-56d585ce-8a8a-4dfc-8a93-46006d1da72a" released by "delete_volume" :: held 0.907s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:18 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376" returned: 0 in 0.339s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Created reservations ['f4f6b1e1-e140-4e85-b7eb-5bf35a73c8f1', 'c672165f-32cc-4744-bf29-76ee5a07e0a6', '3fb694d4-785b-4084-9e9f-2e1a3f2967a5', '9ff00b78-a74e-4c8e-adf8-97c12848158b'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6d85b4-26a7-4f58-9ebd-ab685c217e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5239f1a5-67c6-45d9-9b9f-4ce31d70e0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:18 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Volume volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376 (44ad63a7-f933-43d7-98a5-27e7ac4e0376): created successfully Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5239f1a5-67c6-45d9-9b9f-4ce31d70e0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:18 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Flow 'volume_create_manager' (dbde650f-73bb-4076-9ada-e67fee72e60d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:18 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9798bebc-d957-4b40-8227-f5d98a5d2540 tempest-ProjectReaderTests-1709861829 None] Created volume successfully. Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:19 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:19 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:19 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Flow 'volume_create_manager' (82a62722-66ea-402a-8d53-6a058cd7e885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fcec7c3-28c6-44f5-bb47-3666d3829452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.315s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fcec7c3-28c6-44f5-bb47-3666d3829452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1356860465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8ff82d-53eb-4d7a-81d2-4f9555f2ddba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b6a5a1534643319a4de594f964445e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:19Z,use_quota=True,user_id='e377b14630004b92869907688da89433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2512a048-8aa6-4917-8672-9774cc2a76e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2512a048-8aa6-4917-8672-9774cc2a76e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe1ca0a-a2cf-4b1d-a1e0-8f81fa3c278a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe1ca0a-a2cf-4b1d-a1e0-8f81fa3c278a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be8ff82d-53eb-4d7a-81d2-4f9555f2ddba', 'volume_name': 'volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a2587b-1b65-4200-9e2e-5738a26a02b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a2587b-1b65-4200-9e2e-5738a26a02b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc11a30b-a80b-4b90-8a65-8df9fb006865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:19 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Volume be8ff82d-53eb-4d7a-81d2-4f9555f2ddba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba', 'volume_size': 1} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1356860465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8ff82d-53eb-4d7a-81d2-4f9555f2ddba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b6a5a1534643319a4de594f964445e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:19Z,use_quota=True,user_id='e377b14630004b92869907688da89433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Creating volume be8ff82d-53eb-4d7a-81d2-4f9555f2ddba {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:19 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:19 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Deleted volume successfully. Jul 21 19:19:19 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba 1073741824 Jul 21 19:19:19 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a9327714-c9d7-4a59-b419-1af26419cd2c tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-56d585ce-8a8a-4dfc-8a93-46006d1da72a-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Acquiring lock "cinder-44ad63a7-f933-43d7-98a5-27e7ac4e0376-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Lock "cinder-44ad63a7-f933-43d7-98a5-27e7ac4e0376-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Acquiring lock "cinder-quobyte-44ad63a7-f933-43d7-98a5-27e7ac4e0376" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Lock "cinder-quobyte-44ad63a7-f933-43d7-98a5-27e7ac4e0376" acquired by "delete_volume" :: waited 0.014s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a837debc-87aa-40a9-8ffc-dda53e484880]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:19 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376 Jul 21 19:19:19 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:19 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba 1073741824" returned: 0 in 0.519s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:20 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba Jul 21 19:19:20 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "cinder-39e546e2-00b0-43fe-acfa-7bb79f957849-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-39e546e2-00b0-43fe-acfa-7bb79f957849-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "cinder-quobyte-39e546e2-00b0-43fe-acfa-7bb79f957849" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-quobyte-39e546e2-00b0-43fe-acfa-7bb79f957849" acquired by "delete_volume" :: waited 0.033s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[556a8f7f-8485-4101-8f2d-c1f3a1ea255a]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-39e546e2-00b0-43fe-acfa-7bb79f957849 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:20 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376" returned: 0 in 0.451s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:20 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376 Jul 21 19:19:20 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:20 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba" returned: 0 in 0.346s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc11a30b-a80b-4b90-8a65-8df9fb006865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9642b987-13c1-43a4-a6eb-71ba6fce7116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:20 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-39e546e2-00b0-43fe-acfa-7bb79f957849 Jul 21 19:19:20 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:20 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Volume volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba (be8ff82d-53eb-4d7a-81d2-4f9555f2ddba): created successfully Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9642b987-13c1-43a4-a6eb-71ba6fce7116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Flow 'volume_create_manager' (82a62722-66ea-402a-8d53-6a058cd7e885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:20 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-cab9c9f9-6775-4f6e-b565-fca7cc3f0301 tempest-CinderUnicodeTest-678725853 None] Created volume successfully. Jul 21 19:19:20 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-44ad63a7-f933-43d7-98a5-27e7ac4e0376" returned: 0 in 0.264s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Lock "cinder-quobyte-44ad63a7-f933-43d7-98a5-27e7ac4e0376" released by "delete_volume" :: held 0.763s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Created reservations ['8effc9e6-1723-42b8-aa7d-29f0f3325dd8', '94f090c5-044d-4a42-be40-ee6cec47914f', 'da02d370-97c4-4b57-813d-01d7166ba54b', 'd47afc76-52a3-45b5-b8f6-9db9bd287ca3'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:20 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-39e546e2-00b0-43fe-acfa-7bb79f957849" returned: 0 in 0.412s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-39e546e2-00b0-43fe-acfa-7bb79f957849 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:20 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-39e546e2-00b0-43fe-acfa-7bb79f957849 Jul 21 19:19:20 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:20 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:20 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:20 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-39e546e2-00b0-43fe-acfa-7bb79f957849" returned: 0 in 0.302s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-quobyte-39e546e2-00b0-43fe-acfa-7bb79f957849" released by "delete_volume" :: held 0.760s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:21 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.289s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:21 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Deleted volume successfully. Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Created reservations ['938978b3-bc84-4e08-bc61-20adda1cc049', 'd619a7e6-d718-497d-a02e-031ed9a92a2a', '9580bf8a-1a9a-49e9-8335-6c23aea44e21', '4a5d9d35-bf66-427e-a59b-d2f78ca93448'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f25d8e39-adf7-4fd8-a670-4da4e3de75ee tempest-ProjectReaderTests-1709861829 None] Lock "cinder-44ad63a7-f933-43d7-98a5-27e7ac4e0376-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:21 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:21 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:21 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.261s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "cinder-40f6a306-7f03-46c0-9e80-ad64a1d6f202-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:21 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Deleted volume successfully. Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-40f6a306-7f03-46c0-9e80-ad64a1d6f202-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-31c74bf6-95ec-4167-a491-1bab5c50e454 tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-39e546e2-00b0-43fe-acfa-7bb79f957849-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "cinder-quobyte-40f6a306-7f03-46c0-9e80-ad64a1d6f202" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-quobyte-40f6a306-7f03-46c0-9e80-ad64a1d6f202" acquired by "delete_volume" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca641e03-e097-4c46-b30c-3011f67549a8]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:21 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202 Jul 21 19:19:21 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Flow 'volume_create_manager' (46b6451b-37f5-4103-b59b-2d1fff484810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e98f26-1806-4fe1-b656-94381a0ec4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e98f26-1806-4fe1-b656-94381a0ec4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-176270922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e383c06-fa8e-47ac-8f28-6e7889622497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2e62bd788a490b9aa087f427e4e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:22Z,use_quota=True,user_id='93a17471043a4a5c93cc8f57d1fd8b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757f16f1-b757-4d09-9f37-eec08b984459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757f16f1-b757-4d09-9f37-eec08b984459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d517b5c2-4745-419f-9ce1-eb75541afe37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d517b5c2-4745-419f-9ce1-eb75541afe37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e383c06-fa8e-47ac-8f28-6e7889622497', 'volume_name': 'volume-2e383c06-fa8e-47ac-8f28-6e7889622497', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d46bc2a-8148-424c-97ac-e9a175bf8ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d46bc2a-8148-424c-97ac-e9a175bf8ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617eb4c8-375b-4cbe-b5ec-109a830d93e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:21 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Volume 2e383c06-fa8e-47ac-8f28-6e7889622497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e383c06-fa8e-47ac-8f28-6e7889622497', 'volume_size': 1} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-176270922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e383c06-fa8e-47ac-8f28-6e7889622497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2e62bd788a490b9aa087f427e4e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:22Z,use_quota=True,user_id='93a17471043a4a5c93cc8f57d1fd8b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Creating volume 2e383c06-fa8e-47ac-8f28-6e7889622497 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:21 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2e383c06-fa8e-47ac-8f28-6e7889622497 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:21 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2e383c06-fa8e-47ac-8f28-6e7889622497 1073741824 Jul 21 19:19:21 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (2248e575-a554-4894-8bb8-7cdc2cbbeb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520fce28-a0ec-49ce-94a5-74cd264de56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520fce28-a0ec-49ce-94a5-74cd264de56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-383908283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d46df57-8320-47f2-a938-f52545970674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:22Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45ab115-2510-482d-815e-7b8ace680fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45ab115-2510-482d-815e-7b8ace680fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:21 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f78269b-58e0-46c9-ae69-ef83b26a29cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f78269b-58e0-46c9-ae69-ef83b26a29cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d46df57-8320-47f2-a938-f52545970674', 'volume_name': 'volume-1d46df57-8320-47f2-a938-f52545970674', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fd4731-399a-4f51-9f11-cae420da4cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fd4731-399a-4f51-9f11-cae420da4cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648ca389-8934-49cd-9fd2-477faf039c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:21 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Volume 1d46df57-8320-47f2-a938-f52545970674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d46df57-8320-47f2-a938-f52545970674', 'volume_size': 1} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202" returned: 0 in 0.427s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:21 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202 Jul 21 19:19:21 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:22 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-40f6a306-7f03-46c0-9e80-ad64a1d6f202" returned: 0 in 0.242s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-quobyte-40f6a306-7f03-46c0-9e80-ad64a1d6f202" released by "delete_volume" :: held 0.710s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Created reservations ['e49d4a7b-c309-45c0-b493-af409de7bc6d', '7dddeedd-b99a-4605-8fd4-db3c95a28d95', 'c3346b2f-8938-411b-99ce-19628dd0e706', '813428db-b3e9-4236-836a-74c2db7a7011'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:22 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2e383c06-fa8e-47ac-8f28-6e7889622497 1073741824" returned: 0 in 0.438s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2e383c06-fa8e-47ac-8f28-6e7889622497 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:22 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2e383c06-fa8e-47ac-8f28-6e7889622497 Jul 21 19:19:22 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:22 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:22 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:22 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2e383c06-fa8e-47ac-8f28-6e7889622497" returned: 0 in 0.255s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.692s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "cinder-235249ec-7699-4a08-8e3f-e654dc0c9f24-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:22 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.268s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:22 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Deleted volume successfully. Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] Creating offline snapshot 12e02196-4d03-45bc-85a7-08cd8a64f116 of volume be8ff82d-53eb-4d7a-81d2-4f9555f2ddba {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-235249ec-7699-4a08-8e3f-e654dc0c9f24-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617eb4c8-375b-4cbe-b5ec-109a830d93e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e383c06-fa8e-47ac-8f28-6e7889622497', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c477e0-5252-48a2-93fe-acf238b5ad9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[767d8c75-88f2-4c0c-bdfc-9c9bd24ed440]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-395b4cbe-97c3-429c-abf0-ca785ac38476 tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-40f6a306-7f03-46c0-9e80-ad64a1d6f202-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:22 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Volume volume-2e383c06-fa8e-47ac-8f28-6e7889622497 (2e383c06-fa8e-47ac-8f28-6e7889622497): created successfully Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c477e0-5252-48a2-93fe-acf238b5ad9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Flow 'volume_create_manager' (46b6451b-37f5-4103-b59b-2d1fff484810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "cinder-quobyte-235249ec-7699-4a08-8e3f-e654dc0c9f24" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:22 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-11f78653-c1d9-49e1-ae30-47f40bdd3e03 tempest-ProjectReaderTests-1709861829 None] Created volume successfully. Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-quobyte-235249ec-7699-4a08-8e3f-e654dc0c9f24" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6b71b0-0682-4e74-a1d2-ae5fe355a47d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-235249ec-7699-4a08-8e3f-e654dc0c9f24 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:22 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba Jul 21 19:19:22 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:22 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-235249ec-7699-4a08-8e3f-e654dc0c9f24 Jul 21 19:19:22 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:23 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba" returned: 0 in 0.408s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:23 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 1G Jul 21 19:19:23 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:23 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-235249ec-7699-4a08-8e3f-e654dc0c9f24" returned: 0 in 0.348s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-235249ec-7699-4a08-8e3f-e654dc0c9f24 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:23 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-235249ec-7699-4a08-8e3f-e654dc0c9f24 Jul 21 19:19:23 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:23 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-235249ec-7699-4a08-8e3f-e654dc0c9f24" returned: 0 in 0.289s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-quobyte-235249ec-7699-4a08-8e3f-e654dc0c9f24" released by "delete_volume" :: held 0.693s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:23 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 1G" returned: 0 in 0.423s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:23 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 Jul 21 19:19:23 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Created reservations ['2c9c7a44-58d5-4c7d-9ded-c1b6fe10a4d0', 'fcbcc923-aad6-46a0-9f0d-58a071184ba5', 'a501efb2-de6c-41b1-863d-2a6f21853d5e', '562c4077-e47f-4ff2-814a-92f784686255'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Acquiring lock "cinder-2e383c06-fa8e-47ac-8f28-6e7889622497-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Lock "cinder-2e383c06-fa8e-47ac-8f28-6e7889622497-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Acquiring lock "cinder-quobyte-2e383c06-fa8e-47ac-8f28-6e7889622497" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Lock "cinder-quobyte-2e383c06-fa8e-47ac-8f28-6e7889622497" acquired by "delete_volume" :: waited 0.040s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:23 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:23 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e177cd-2f92-4f74-9b98-5adeeef57bf4]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2e383c06-fa8e-47ac-8f28-6e7889622497 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "cinder-4dcecba1-10db-483c-9ec7-1705d8103a8b-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-4dcecba1-10db-483c-9ec7-1705d8103a8b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:23 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "cinder-quobyte-4dcecba1-10db-483c-9ec7-1705d8103a8b" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116" returned: 0 in 0.367s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:23 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 is being set with open permissions: ugo+rw Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-quobyte-4dcecba1-10db-483c-9ec7-1705d8103a8b" acquired by "delete_volume" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:23 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 Jul 21 19:19:23 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5b7fad-cb03-4c03-aeb3-13a42a44082d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4dcecba1-10db-483c-9ec7-1705d8103a8b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:23 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2e383c06-fa8e-47ac-8f28-6e7889622497 Jul 21 19:19:23 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:24 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4dcecba1-10db-483c-9ec7-1705d8103a8b Jul 21 19:19:24 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:24 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.345s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:24 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Deleted volume successfully. Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5e36c616-7990-40de-8de4-eb35673c1fdf tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-235249ec-7699-4a08-8e3f-e654dc0c9f24-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:24 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116" returned: 0 in 0.292s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:24 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2e383c06-fa8e-47ac-8f28-6e7889622497" returned: 0 in 0.423s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2e383c06-fa8e-47ac-8f28-6e7889622497 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:24 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2e383c06-fa8e-47ac-8f28-6e7889622497 Jul 21 19:19:24 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:24 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.info Jul 21 19:19:24 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:24 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4dcecba1-10db-483c-9ec7-1705d8103a8b" returned: 0 in 0.388s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4dcecba1-10db-483c-9ec7-1705d8103a8b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:24 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4dcecba1-10db-483c-9ec7-1705d8103a8b Jul 21 19:19:24 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:24 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-2e383c06-fa8e-47ac-8f28-6e7889622497" returned: 0 in 0.259s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Lock "cinder-quobyte-2e383c06-fa8e-47ac-8f28-6e7889622497" released by "delete_volume" :: held 0.728s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:24 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.info" returned: 0 in 0.263s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:24 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.info is being set with open permissions: ugo+rw Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:24 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.info Jul 21 19:19:24 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Created reservations ['9b30c5fa-9d3b-479f-a63c-92615c75b1f1', 'b5ccc4bd-7dcc-40b4-a722-f4cac65f02b5', '24fd420e-0ddf-4df8-91e7-b00f4f44cc93', '3225a850-89ae-4add-9492-f76bc941cf88'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:24 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4dcecba1-10db-483c-9ec7-1705d8103a8b" returned: 0 in 0.267s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-quobyte-4dcecba1-10db-483c-9ec7-1705d8103a8b" released by "delete_volume" :: held 0.708s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:24 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:24 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Created reservations ['b3b0b23f-fd19-4af2-9706-7e7765c6af85', '7e4bf275-da73-4406-bae0-64d2cd193413', '23325a62-2cde-431a-992b-e3d4402a7575', '97c3aad1-1b66-4cc9-b07f-71586d8428bc'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:24 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.info" returned: 0 in 0.286s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.854s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-383908283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d46df57-8320-47f2-a938-f52545970674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:22Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Creating volume 1d46df57-8320-47f2-a938-f52545970674 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:24 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:24 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674 1073741824 Jul 21 19:19:24 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:24 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5fbcd02e-38bd-4521-bdd9-da8316356608 tempest-CinderUnicodeTest-678725853 None] Create snapshot completed successfully Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:24 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:24 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:24 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.341s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Deleted volume successfully. Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-60250bab-2202-46eb-9864-0f866ac39a5f tempest-ProjectReaderTests-1709861829 None] Lock "cinder-2e383c06-fa8e-47ac-8f28-6e7889622497-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:25 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.306s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Deleted volume successfully. Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f72d478e-fe87-419f-b492-22af072d0a88 tempest-CreateVolumesFromImageTest-717929934 None] Lock "cinder-4dcecba1-10db-483c-9ec7-1705d8103a8b-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:25 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674 1073741824" returned: 0 in 0.577s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:25 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674 Jul 21 19:19:25 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:25 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674" returned: 0 in 0.255s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648ca389-8934-49cd-9fd2-477faf039c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d46df57-8320-47f2-a938-f52545970674', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e1df79-9532-4696-938d-fd40b5d19cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:25 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Volume volume-1d46df57-8320-47f2-a938-f52545970674 (1d46df57-8320-47f2-a938-f52545970674): created successfully Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e1df79-9532-4696-938d-fd40b5d19cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:25 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (2248e575-a554-4894-8bb8-7cdc2cbbeb2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5627e4f3-8e81-4536-9699-762729411853 tempest-ProjectMemberTests-1585065700 None] Created volume successfully. Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Acquiring lock "cinder-12e02196-4d03-45bc-85a7-08cd8a64f116-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Lock "cinder-12e02196-4d03-45bc-85a7-08cd8a64f116-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Acquiring lock "cinder-quobyte-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Lock "cinder-quobyte-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Acquiring lock "cinder-quobyte-12e02196-4d03-45bc-85a7-08cd8a64f116" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Lock "cinder-quobyte-12e02196-4d03-45bc-85a7-08cd8a64f116" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Deleting offline snapshot 12e02196-4d03-45bc-85a7-08cd8a64f116 of volume be8ff82d-53eb-4d7a-81d2-4f9555f2ddba {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] snapshot_file for this snap is: volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf355087-b2aa-4be9-bc1e-c99f96f31a21]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:26 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 Jul 21 19:19:26 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] Creating offline snapshot bbb8602e-69f1-45a7-a880-a76c6a509ac6 of volume 1d46df57-8320-47f2-a938-f52545970674 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcd2eb0-56d4-4f47-88a0-209ff9944b89]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:26 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116" returned: 0 in 0.497s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:26 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674 Jul 21 19:19:26 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[de91f8b7-d393-4eb2-a05d-be208417bbc9]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:26 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba Jul 21 19:19:26 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:27 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674" returned: 0 in 0.469s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:27 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 1G Jul 21 19:19:27 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:27 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba" returned: 0 in 0.431s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:27 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 Jul 21 19:19:27 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:27 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 1G" returned: 0 in 0.447s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d46df57-8320-47f2-a938-f52545970674 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:27 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d46df57-8320-47f2-a938-f52545970674 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 Jul 21 19:19:27 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:27 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116" returned: 0 in 0.463s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:27 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116 Jul 21 19:19:27 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:27 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d46df57-8320-47f2-a938-f52545970674 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6" returned: 0 in 0.361s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:27 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 is being set with open permissions: ugo+rw Jul 21 19:19:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:27 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 Jul 21 19:19:27 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:27 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba.12e02196-4d03-45bc-85a7-08cd8a64f116" returned: 0 in 0.308s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Lock "cinder-quobyte-12e02196-4d03-45bc-85a7-08cd8a64f116" released by "_delete_snapshot" :: held 1.856s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Lock "cinder-quobyte-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba" released by "delete_snapshot" :: held 1.889s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Created reservations ['2f14c393-3b6a-4b39-8cab-c02f36b920a6', '75e4dc9f-1428-4d82-80ee-d0152481ba8f', '88590b16-9072-400f-aab8-5652717c695e', '905353fd-eb3b-4663-943a-fd1a31e75ba3'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:28 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Delete snapshot completed successfully. Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-0edc149e-d64c-4cec-8ca5-64b7789b74d6 tempest-CinderUnicodeTest-678725853 None] Lock "cinder-12e02196-4d03-45bc-85a7-08cd8a64f116-delete_snapshot" released by "delete_snapshot" :: held 2.073s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:28 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6" returned: 0 in 0.318s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:28 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.info Jul 21 19:19:28 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:28 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Acquiring lock "cinder-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.info" returned: 0 in 0.257s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:28 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.info is being set with open permissions: ugo+rw Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Lock "cinder-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:28 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.info Jul 21 19:19:28 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Acquiring lock "cinder-quobyte-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Lock "cinder-quobyte-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c268f2-412e-4213-9301-0388f2a2990c]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:28 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:28 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba Jul 21 19:19:28 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.info" returned: 0 in 0.391s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:28 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-75dc327e-75d6-4841-b7a4-1bf4c307789b tempest-ProjectMemberTests-1585065700 None] Create snapshot completed successfully Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:28 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Flow 'volume_create_manager' (c98dbc8c-90a9-4876-8359-5b06b9002205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace79ddd-f11b-4b90-8fbd-21f0b41e8f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace79ddd-f11b-4b90-8fbd-21f0b41e8f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1030721136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83503fc-bbad-4a2a-8b47-88ece3ad691f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa466e37e404413a60e0455bad93a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:29Z,use_quota=True,user_id='7a55751064a14dc09cc91ce315d43c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ddead0-eff6-4c37-a0a3-150e1ce2a9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ddead0-eff6-4c37-a0a3-150e1ce2a9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8642ab-f111-4f37-a2a7-6f922928de81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8642ab-f111-4f37-a2a7-6f922928de81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83503fc-bbad-4a2a-8b47-88ece3ad691f', 'volume_name': 'volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62bb46e8-8ea2-4d5d-a0d2-b5f17a8f2c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62bb46e8-8ea2-4d5d-a0d2-b5f17a8f2c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345ace57-a088-478a-9e5e-fcfa6ce176f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:29 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume b83503fc-bbad-4a2a-8b47-88ece3ad691f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f', 'volume_size': 1} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1030721136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83503fc-bbad-4a2a-8b47-88ece3ad691f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa466e37e404413a60e0455bad93a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:29Z,use_quota=True,user_id='7a55751064a14dc09cc91ce315d43c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Creating volume b83503fc-bbad-4a2a-8b47-88ece3ad691f {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:29 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:29 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f 1073741824 Jul 21 19:19:29 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:29 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba" returned: 0 in 0.473s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:29 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba Jul 21 19:19:29 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:29 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba" returned: 0 in 0.280s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Lock "cinder-quobyte-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba" released by "delete_volume" :: held 0.858s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Created reservations ['31ac13c3-dab5-40d6-9449-6d623cb5f364', 'c7ea882b-1c42-40b4-9fbe-d913a9a1d4b2', '588c1808-3def-4d5f-84eb-1145349f9542', '03c83a50-0b5b-4510-8446-2f4f1ef6bd31'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:29 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f 1073741824" returned: 0 in 0.487s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:29 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:29 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:29 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f Jul 21 19:19:29 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Acquiring lock "cinder-18e7dd50-4e4b-49e5-a514-31d263fb9c6a-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Lock "cinder-18e7dd50-4e4b-49e5-a514-31d263fb9c6a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-bbb8602e-69f1-45a7-a880-a76c6a509ac6-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Acquiring lock "cinder-quobyte-18e7dd50-4e4b-49e5-a514-31d263fb9c6a" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-bbb8602e-69f1-45a7-a880-a76c6a509ac6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-1d46df57-8320-47f2-a938-f52545970674" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Lock "cinder-quobyte-18e7dd50-4e4b-49e5-a514-31d263fb9c6a" acquired by "delete_volume" :: waited 0.037s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:29 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.308s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:29 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Deleted volume successfully. Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-1d46df57-8320-47f2-a938-f52545970674" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-bbb8602e-69f1-45a7-a880-a76c6a509ac6" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91c92c3-aa43-4d50-b52c-a245189aad47]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-bbb8602e-69f1-45a7-a880-a76c6a509ac6" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Deleting offline snapshot bbb8602e-69f1-45a7-a880-a76c6a509ac6 of volume 1d46df57-8320-47f2-a938-f52545970674 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] snapshot_file for this snap is: volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6670d41a-9faa-4448-bff9-f04c5c004c9e tempest-CinderUnicodeTest-678725853 None] Lock "cinder-be8ff82d-53eb-4d7a-81d2-4f9555f2ddba-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:30 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f" returned: 0 in 0.416s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc54b2a2-7f23-40f8-954a-eedd9bc8c426]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345ace57-a088-478a-9e5e-fcfa6ce176f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66104d76-525e-4f42-9f5d-10542375d6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:30 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f (b83503fc-bbad-4a2a-8b47-88ece3ad691f): created successfully Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66104d76-525e-4f42-9f5d-10542375d6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Flow 'volume_create_manager' (c98dbc8c-90a9-4876-8359-5b06b9002205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:30 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-e5b7201b-cd67-47ff-96d4-7c9ca0bf5115 tempest-CreateVolumesFromSnapshotTest-419078405 None] Created volume successfully. Jul 21 19:19:30 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a Jul 21 19:19:30 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:30 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 Jul 21 19:19:30 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:30 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:30 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a" returned: 0 in 0.481s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6" returned: 0 in 0.390s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d46df57-8320-47f2-a938-f52545970674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:30 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a Jul 21 19:19:30 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edcdc41-3d20-4958-8f07-1557102059ba]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:30 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674 Jul 21 19:19:30 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:30 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-18e7dd50-4e4b-49e5-a514-31d263fb9c6a" returned: 0 in 0.253s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Lock "cinder-quobyte-18e7dd50-4e4b-49e5-a514-31d263fb9c6a" released by "delete_volume" :: held 0.817s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Created reservations ['5c2b552b-2c27-415a-a9d6-bfc385c133c3', '6d6e4895-ab81-456b-baad-880b401f3bce', 'f03dcb3d-346f-4ac5-a691-e85648eacfcc', 'fcd60e58-a974-4a10-8ce7-c7f7156236f2'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:30 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:30 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:30 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674" returned: 0 in 0.405s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:30 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 Jul 21 19:19:30 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:31 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.286s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:31 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Deleted volume successfully. Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ac625be7-8ec6-4399-b53e-9259ef6bfc05 tempest-CinderUnicodeTest-678725853 None] Lock "cinder-18e7dd50-4e4b-49e5-a514-31d263fb9c6a-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:31 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6" returned: 0 in 0.527s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] Creating offline snapshot 38d8142e-3767-4482-9a6c-16b7b0102c1d of volume b83503fc-bbad-4a2a-8b47-88ece3ad691f {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:31 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6 Jul 21 19:19:31 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c4f16f-f7e4-4be2-890f-cdc241865baf]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:31 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f Jul 21 19:19:31 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:31 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674.bbb8602e-69f1-45a7-a880-a76c6a509ac6" returned: 0 in 0.336s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-bbb8602e-69f1-45a7-a880-a76c6a509ac6" released by "_delete_snapshot" :: held 1.816s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-1d46df57-8320-47f2-a938-f52545970674" released by "delete_snapshot" :: held 1.868s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Created reservations ['6929b00d-e1a3-4e6b-b9cf-14a47c1a840a', '6d280679-e73e-4066-98dc-55298584af47', 'a555f5bc-31ff-4253-a990-75397f12313b', '7f28b340-ca3e-4492-be0a-6089dedf7d1d'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:31 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f" returned: 0 in 0.468s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:31 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d 1G Jul 21 19:19:31 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:32 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Delete snapshot completed successfully. Jul 21 19:19:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5efb2f91-898c-4fdc-9b40-4aa02a525994 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-bbb8602e-69f1-45a7-a880-a76c6a509ac6-delete_snapshot" released by "delete_snapshot" :: held 2.146s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-1d46df57-8320-47f2-a938-f52545970674-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-1d46df57-8320-47f2-a938-f52545970674-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-1d46df57-8320-47f2-a938-f52545970674" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-1d46df57-8320-47f2-a938-f52545970674" acquired by "delete_volume" :: waited 0.016s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:32 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d00ba3-8ef5-4f5e-b16c-faf361390403]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:32 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674 Jul 21 19:19:32 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:32 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d 1G" returned: 0 in 0.613s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:32 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d Jul 21 19:19:32 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:32 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674" returned: 0 in 0.510s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:32 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674 Jul 21 19:19:32 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:32 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d" returned: 0 in 0.356s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:32 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d is being set with open permissions: ugo+rw Jul 21 19:19:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:32 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d Jul 21 19:19:32 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:33 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-1d46df57-8320-47f2-a938-f52545970674" returned: 0 in 0.305s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-1d46df57-8320-47f2-a938-f52545970674" released by "delete_volume" :: held 0.886s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:33 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d" returned: 0 in 0.292s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Created reservations ['40fea71a-615c-432f-8d19-95a242d4ecd5', '49fab483-25cf-48f6-b61a-040175c9353f', '5fa682a6-887f-4d45-aa5e-4407dc786850', '6449a6d0-19d2-4126-bfb5-6b83d5b2a07e'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:33 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.info Jul 21 19:19:33 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:33 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:33 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:33 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.info" returned: 0 in 0.365s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:33 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.info is being set with open permissions: ugo+rw Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:33 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.305s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:33 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Deleted volume successfully. Jul 21 19:19:33 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.info Jul 21 19:19:33 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8caee519-d9c8-45c9-84d4-d63c85d96951 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-1d46df57-8320-47f2-a938-f52545970674-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:33 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.info" returned: 0 in 0.312s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:34 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-581d7f0e-114d-4c5d-b860-a409b366a39d tempest-CreateVolumesFromSnapshotTest-419078405 None] Create snapshot completed successfully Jul 21 19:19:34 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (9bbd7ac0-9400-4bc7-90a8-51553d6b5cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2365f505-b670-401f-91ce-ee58cd0b1ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2365f505-b670-401f-91ce-ee58cd0b1ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-202151020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:35Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332af868-bc35-4fb5-b29e-b1c724cc34ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332af868-bc35-4fb5-b29e-b1c724cc34ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92b848d-b5c4-4af6-b01f-72553e9ccd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92b848d-b5c4-4af6-b01f-72553e9ccd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4', 'volume_name': 'volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7fb49b9-25ca-4da7-8a2d-cf9bde5ab06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7fb49b9-25ca-4da7-8a2d-cf9bde5ab06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6185639f-d1de-4a95-aea9-6e518afc0cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:35 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Volume dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4', 'volume_size': 1} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-202151020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:35Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Creating volume dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:35 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:35 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 1073741824 Jul 21 19:19:35 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Flow 'volume_create_manager' (630f9fe8-89a0-4526-90e0-d395c4a414a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a190509-cddc-4704-8f3a-04c4716ba0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a190509-cddc-4704-8f3a-04c4716ba0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-779397232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726d600e5eaa40059fcc9882bbfd1d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:35Z,use_quota=True,user_id='d202e5a031a14a99b430f1c9e7068b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c31f3fc-d676-4a0a-a05c-c24c70beb361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c31f3fc-d676-4a0a-a05c-c24c70beb361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df49fd8-5c0b-40d8-9a91-435ea5f2c24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df49fd8-5c0b-40d8-9a91-435ea5f2c24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac', 'volume_name': 'volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4790a3b1-d9c4-4426-a52e-0faaf3d9adfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4790a3b1-d9c4-4426-a52e-0faaf3d9adfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427b760b-bd10-4036-9579-26d2f9e0ca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:35 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Volume 187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac', 'volume_size': 1} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:35 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 1073741824" returned: 0 in 0.616s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:35 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 Jul 21 19:19:35 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Flow 'volume_create_manager' (70b45870-812d-4e08-89f6-69911c0cda22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:35 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a590f64-a99f-403e-8889-37e22cd8d964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a590f64-a99f-403e-8889-37e22cd8d964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-602271193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e7181b-b259-4c51-a654-691509ab9742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa466e37e404413a60e0455bad93a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:36Z,use_quota=True,user_id='7a55751064a14dc09cc91ce315d43c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dad2ae-95b2-4853-bc56-716acb8ca6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dad2ae-95b2-4853-bc56-716acb8ca6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839bffb9-6e80-4799-a7f9-7833b50d3407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839bffb9-6e80-4799-a7f9-7833b50d3407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60e7181b-b259-4c51-a654-691509ab9742', 'volume_name': 'volume-60e7181b-b259-4c51-a654-691509ab9742', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9db5ef4-03c0-443a-b2af-b00091ce6925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9db5ef4-03c0-443a-b2af-b00091ce6925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e0cb9d-3c0b-40d9-b649-4f3463b796e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume 60e7181b-b259-4c51-a654-691509ab9742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60e7181b-b259-4c51-a654-691509ab9742', 'volume_size': 1} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4" returned: 0 in 0.336s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-779397232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726d600e5eaa40059fcc9882bbfd1d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:35Z,use_quota=True,user_id='d202e5a031a14a99b430f1c9e7068b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Creating volume 187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:36 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:36 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac 1073741824 Jul 21 19:19:36 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6185639f-d1de-4a95-aea9-6e518afc0cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47131dd6-fa83-4da5-a684-7664ccaaf090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Flow 'volume_create_manager' (796f37e0-a0ae-4549-ae82-8d259d4d915f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687e6c67-9da9-41e0-84ac-3488ba552da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687e6c67-9da9-41e0-84ac-3488ba552da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1313678978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=140c9dcb-aa10-42b8-b447-4abc8df6fd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97f7701be0144328fcd9e74a3439495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:36Z,use_quota=True,user_id='93b6fc418e594de8a51459511ada5ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51df07ea-29fd-459e-981c-5430dda15d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51df07ea-29fd-459e-981c-5430dda15d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fdae75-0fe1-4c99-8d20-c6b04e1ee8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fdae75-0fe1-4c99-8d20-c6b04e1ee8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '140c9dcb-aa10-42b8-b447-4abc8df6fd9c', 'volume_name': 'volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ffd8cf-99fc-42cb-86ff-e76a63b15417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ffd8cf-99fc-42cb-86ff-e76a63b15417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148bd671-dc60-4d3d-aa50-81400148f385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Volume 140c9dcb-aa10-42b8-b447-4abc8df6fd9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c', 'volume_size': 1} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:36 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Volume volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 (dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4): created successfully Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47131dd6-fa83-4da5-a684-7664ccaaf090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (9bbd7ac0-9400-4bc7-90a8-51553d6b5cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Flow 'volume_create_manager' (31eca9bc-6e3e-4cb4-b978-0952b11dee19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052ef389-7b8d-466e-a533-351ffc29f610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-7af09af1-4f09-4047-9161-0e21ccb4c6ca tempest-ProjectMemberTests-1585065700 None] Created volume successfully. Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052ef389-7b8d-466e-a533-351ffc29f610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-996159792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e94c43-603d-4ab1-b303-f20ebaf74323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa466e37e404413a60e0455bad93a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:36Z,use_quota=True,user_id='7a55751064a14dc09cc91ce315d43c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2612d57e-a8b7-4c72-a37a-45ccdaf6ab88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2612d57e-a8b7-4c72-a37a-45ccdaf6ab88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f581ac-ea87-4f09-99c5-490b82a28631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f581ac-ea87-4f09-99c5-490b82a28631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e94c43-603d-4ab1-b303-f20ebaf74323', 'volume_name': 'volume-e8e94c43-603d-4ab1-b303-f20ebaf74323', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02a7947-3255-418d-b6bc-d5b8e480920e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02a7947-3255-418d-b6bc-d5b8e480920e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8944d10-dcc6-4c1c-823a-4328a44fa7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume e8e94c43-603d-4ab1-b303-f20ebaf74323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e94c43-603d-4ab1-b303-f20ebaf74323', 'volume_size': 1} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Flow 'volume_create_manager' (5da65af8-dbd0-4bc0-901b-c3d026f051c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f6713e-3de4-4811-8c71-aba095bd923f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f6713e-3de4-4811-8c71-aba095bd923f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1028290304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dfdc7a-9845-4b55-9b2e-9dcbf4019855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa466e37e404413a60e0455bad93a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:36Z,use_quota=True,user_id='7a55751064a14dc09cc91ce315d43c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f155af9-914d-4e8c-93bd-671fecf8459e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f155af9-914d-4e8c-93bd-671fecf8459e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02efb9fb-f113-43a2-9a17-f5a0f3981c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02efb9fb-f113-43a2-9a17-f5a0f3981c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3dfdc7a-9845-4b55-9b2e-9dcbf4019855', 'volume_name': 'volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f266e4-8990-48a8-a74a-965c479b0d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f266e4-8990-48a8-a74a-965c479b0d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236d7f4c-5f7a-4d8c-939e-d0b86c292a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume a3dfdc7a-9845-4b55-9b2e-9dcbf4019855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855', 'volume_size': 1} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac 1073741824" returned: 0 in 0.575s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:36 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac Jul 21 19:19:36 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Flow 'volume_create_manager' (7f3c1014-f129-4ed3-b48c-348f98da4b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929e854b-a850-4825-8004-374c3cd795cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929e854b-a850-4825-8004-374c3cd795cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-494299385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a549392f-b898-4709-b4c7-89c92047fa10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa466e37e404413a60e0455bad93a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:37Z,use_quota=True,user_id='7a55751064a14dc09cc91ce315d43c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6390b2-b3b2-45e2-8799-f1ec63c1cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6390b2-b3b2-45e2-8799-f1ec63c1cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f52ac2d-35b1-40b0-9784-5f8dc76e0359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f52ac2d-35b1-40b0-9784-5f8dc76e0359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a549392f-b898-4709-b4c7-89c92047fa10', 'volume_name': 'volume-a549392f-b898-4709-b4c7-89c92047fa10', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61962a57-5f67-431b-97b1-3cf175af41a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61962a57-5f67-431b-97b1-3cf175af41a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2b425a-0019-4b87-b51f-166e73cfc009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume a549392f-b898-4709-b4c7-89c92047fa10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a549392f-b898-4709-b4c7-89c92047fa10', 'volume_size': 1} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:36 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac" returned: 0 in 0.256s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.904s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-602271193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e7181b-b259-4c51-a654-691509ab9742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa466e37e404413a60e0455bad93a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:36Z,use_quota=True,user_id='7a55751064a14dc09cc91ce315d43c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Creating volume 60e7181b-b259-4c51-a654-691509ab9742 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:36 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-60e7181b-b259-4c51-a654-691509ab9742 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427b760b-bd10-4036-9579-26d2f9e0ca04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:37 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-60e7181b-b259-4c51-a654-691509ab9742 1073741824 Jul 21 19:19:37 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd5bd67-8b96-460f-a589-e9eda2e469a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:37 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Volume volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac (187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac): created successfully Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd5bd67-8b96-460f-a589-e9eda2e469a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Flow 'volume_create_manager' (630f9fe8-89a0-4526-90e0-d395c4a414a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:37 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-52627759-3c71-4845-8ad0-4afa5e927da1 tempest-ProjectReaderTests-370653668 None] Created volume successfully. Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Flow 'volume_create_manager' (95d251d9-9c68-4dbf-8614-90ab0a69f0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5b4d66-5682-40b8-9a25-7de40213a819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5b4d66-5682-40b8-9a25-7de40213a819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2053583987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12858325-e4ec-4b8e-81db-25105777997f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa466e37e404413a60e0455bad93a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:37Z,use_quota=True,user_id='7a55751064a14dc09cc91ce315d43c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f368f0aa-aaf5-4542-9136-ea38a9784f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f368f0aa-aaf5-4542-9136-ea38a9784f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a580c0-7b12-4fa6-a06f-6acd8688da54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a580c0-7b12-4fa6-a06f-6acd8688da54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12858325-e4ec-4b8e-81db-25105777997f', 'volume_name': 'volume-12858325-e4ec-4b8e-81db-25105777997f', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fd5a7a-cfc0-4e00-b5c8-e1d861367c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fd5a7a-cfc0-4e00-b5c8-e1d861367c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d25aa1-9f08-479d-a834-29b7900331dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:37 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume 12858325-e4ec-4b8e-81db-25105777997f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12858325-e4ec-4b8e-81db-25105777997f', 'volume_size': 1} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:37 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-60e7181b-b259-4c51-a654-691509ab9742 1073741824" returned: 0 in 0.482s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-60e7181b-b259-4c51-a654-691509ab9742 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:37 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-60e7181b-b259-4c51-a654-691509ab9742 Jul 21 19:19:37 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:37 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-60e7181b-b259-4c51-a654-691509ab9742" returned: 0 in 0.266s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.519s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1313678978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=140c9dcb-aa10-42b8-b447-4abc8df6fd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97f7701be0144328fcd9e74a3439495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:36Z,use_quota=True,user_id='93b6fc418e594de8a51459511ada5ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Creating volume 140c9dcb-aa10-42b8-b447-4abc8df6fd9c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:37 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:37 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c 1073741824 Jul 21 19:19:37 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e0cb9d-3c0b-40d9-b649-4f3463b796e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60e7181b-b259-4c51-a654-691509ab9742', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e688b3d4-91e2-4563-b72f-e5a84948038a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:37 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume volume-60e7181b-b259-4c51-a654-691509ab9742 (60e7181b-b259-4c51-a654-691509ab9742): created successfully Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e688b3d4-91e2-4563-b72f-e5a84948038a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Flow 'volume_create_manager' (70b45870-812d-4e08-89f6-69911c0cda22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:37 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-61f0c19d-dd94-4de0-bee0-cb910acd9f1d tempest-CreateVolumesFromSnapshotTest-419078405 None] Created volume successfully. Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Acquiring lock "cinder-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Lock "cinder-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Acquiring lock "cinder-quobyte-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Lock "cinder-quobyte-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[29111087-89de-4dc5-943b-ede5e8b1e223]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:38 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac Jul 21 19:19:38 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:38 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c 1073741824" returned: 0 in 0.477s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:38 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c Jul 21 19:19:38 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:38 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac" returned: 0 in 0.381s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:38 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac Jul 21 19:19:38 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:38 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c" returned: 0 in 0.242s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.185s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-996159792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e94c43-603d-4ab1-b303-f20ebaf74323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa466e37e404413a60e0455bad93a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:36Z,use_quota=True,user_id='7a55751064a14dc09cc91ce315d43c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Creating volume e8e94c43-603d-4ab1-b303-f20ebaf74323 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:38 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8e94c43-603d-4ab1-b303-f20ebaf74323 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:38 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8e94c43-603d-4ab1-b303-f20ebaf74323 1073741824 Jul 21 19:19:38 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148bd671-dc60-4d3d-aa50-81400148f385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71666fa-badc-43dd-9cf4-91070b50bb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:38 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Volume volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c (140c9dcb-aa10-42b8-b447-4abc8df6fd9c): created successfully Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71666fa-badc-43dd-9cf4-91070b50bb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:38 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Flow 'volume_create_manager' (796f37e0-a0ae-4549-ae82-8d259d4d915f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac" returned: 0 in 0.309s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Lock "cinder-quobyte-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac" released by "delete_volume" :: held 0.736s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:38 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d197ab64-f73c-4ad3-b0bf-441ba90d3ce7 tempest-ProjectReaderTests-911164663 None] Created volume successfully. Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Created reservations ['f5fe0162-2b7c-4cd7-864b-95079feb0e13', 'fa9f159e-30dc-46d5-89c8-665422a422c5', '3e1fbe7c-8383-44c2-88f6-a2a89432dad3', 'caf34d9a-7951-4d6d-a941-3c1ddefb592b'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:38 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:38 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:39 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8e94c43-603d-4ab1-b303-f20ebaf74323 1073741824" returned: 0 in 0.499s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8e94c43-603d-4ab1-b303-f20ebaf74323 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:39 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8e94c43-603d-4ab1-b303-f20ebaf74323 Jul 21 19:19:39 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:39 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.266s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:39 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Deleted volume successfully. Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-889533c4-cae2-4693-86ed-c8e379206820 tempest-ProjectReaderTests-370653668 None] Lock "cinder-187a0132-4e1e-4d35-83f2-5aa1ca4cc0ac-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:39 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8e94c43-603d-4ab1-b303-f20ebaf74323" returned: 0 in 0.259s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.671s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1028290304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dfdc7a-9845-4b55-9b2e-9dcbf4019855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa466e37e404413a60e0455bad93a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:36Z,use_quota=True,user_id='7a55751064a14dc09cc91ce315d43c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Creating volume a3dfdc7a-9845-4b55-9b2e-9dcbf4019855 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:39 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8944d10-dcc6-4c1c-823a-4328a44fa7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e94c43-603d-4ab1-b303-f20ebaf74323', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:39 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855 1073741824 Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7278c9c-d4b1-45b1-90ab-df3251530e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:39 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:39 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume volume-e8e94c43-603d-4ab1-b303-f20ebaf74323 (e8e94c43-603d-4ab1-b303-f20ebaf74323): created successfully Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7278c9c-d4b1-45b1-90ab-df3251530e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Flow 'volume_create_manager' (31eca9bc-6e3e-4cb4-b978-0952b11dee19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:39 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f86f5aea-d590-4c76-8c94-53a0707a9e58 tempest-CreateVolumesFromSnapshotTest-419078405 None] Created volume successfully. Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Flow 'volume_create_manager' (eac05cc1-1bad-4a3f-8cb1-8d6c06b2f376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a351a4a-61bd-4b2d-84e3-4559e8ce1e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a351a4a-61bd-4b2d-84e3-4559e8ce1e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39738382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd5c551-dd30-4be1-8132-cb4fcadb0157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726d600e5eaa40059fcc9882bbfd1d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:40Z,use_quota=True,user_id='d202e5a031a14a99b430f1c9e7068b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa2dde0-51bd-4579-911a-cf4be1ba04eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa2dde0-51bd-4579-911a-cf4be1ba04eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c39887b-b06b-4e73-a3b7-632d624fee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c39887b-b06b-4e73-a3b7-632d624fee23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd5c551-dd30-4be1-8132-cb4fcadb0157', 'volume_name': 'volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d446d99a-e57e-419c-8f3e-3afa43fdcc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d446d99a-e57e-419c-8f3e-3afa43fdcc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd9c09e-8fca-49b0-b6e8-2eb8490aac2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:39 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Volume 7dd5c551-dd30-4be1-8132-cb4fcadb0157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157', 'volume_size': 1} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:39 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855 1073741824" returned: 0 in 0.416s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:39 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855 Jul 21 19:19:39 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:40 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855" returned: 0 in 0.250s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.117s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-494299385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a549392f-b898-4709-b4c7-89c92047fa10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa466e37e404413a60e0455bad93a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:37Z,use_quota=True,user_id='7a55751064a14dc09cc91ce315d43c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Creating volume a549392f-b898-4709-b4c7-89c92047fa10 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:40 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a549392f-b898-4709-b4c7-89c92047fa10 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236d7f4c-5f7a-4d8c-939e-d0b86c292a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:40 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a549392f-b898-4709-b4c7-89c92047fa10 1073741824 Jul 21 19:19:40 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faac71e6-f449-4b13-b8b4-a1cc526a07c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:40 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855 (a3dfdc7a-9845-4b55-9b2e-9dcbf4019855): created successfully Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faac71e6-f449-4b13-b8b4-a1cc526a07c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Flow 'volume_create_manager' (5da65af8-dbd0-4bc0-901b-c3d026f051c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:40 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3c2ff8ba-07ee-474c-8f60-49858deb84cc tempest-CreateVolumesFromSnapshotTest-419078405 None] Created volume successfully. Jul 21 19:19:40 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a549392f-b898-4709-b4c7-89c92047fa10 1073741824" returned: 0 in 0.433s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a549392f-b898-4709-b4c7-89c92047fa10 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:40 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a549392f-b898-4709-b4c7-89c92047fa10 Jul 21 19:19:40 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:40 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:40 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:40 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a549392f-b898-4709-b4c7-89c92047fa10" returned: 0 in 0.245s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.459s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2053583987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12858325-e4ec-4b8e-81db-25105777997f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa466e37e404413a60e0455bad93a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:37Z,use_quota=True,user_id='7a55751064a14dc09cc91ce315d43c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Creating volume 12858325-e4ec-4b8e-81db-25105777997f {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:40 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12858325-e4ec-4b8e-81db-25105777997f 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2b425a-0019-4b87-b51f-166e73cfc009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a549392f-b898-4709-b4c7-89c92047fa10', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:40 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12858325-e4ec-4b8e-81db-25105777997f 1073741824 Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4360f24-b6fe-4a5a-a3c1-99ab68aaae65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:40 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:40 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume volume-a549392f-b898-4709-b4c7-89c92047fa10 (a549392f-b898-4709-b4c7-89c92047fa10): created successfully Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4360f24-b6fe-4a5a-a3c1-99ab68aaae65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Flow 'volume_create_manager' (7f3c1014-f129-4ed3-b48c-348f98da4b14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:40 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b4342512-b905-4933-baae-c99282f3436d tempest-CreateVolumesFromSnapshotTest-419078405 None] Created volume successfully. Jul 21 19:19:40 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.253s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:19:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:19:41 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12858325-e4ec-4b8e-81db-25105777997f 1073741824" returned: 0 in 0.428s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12858325-e4ec-4b8e-81db-25105777997f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:41 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12858325-e4ec-4b8e-81db-25105777997f Jul 21 19:19:41 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:41 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12858325-e4ec-4b8e-81db-25105777997f" returned: 0 in 0.229s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.071s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d25aa1-9f08-479d-a834-29b7900331dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12858325-e4ec-4b8e-81db-25105777997f', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963dea68-bf9f-4ae4-bffe-a6bcd1d94370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] Creating offline snapshot cff76c4a-01ff-4c98-8654-e06b7005a583 of volume dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:41 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Volume volume-12858325-e4ec-4b8e-81db-25105777997f (12858325-e4ec-4b8e-81db-25105777997f): created successfully Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963dea68-bf9f-4ae4-bffe-a6bcd1d94370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Flow 'volume_create_manager' (95d251d9-9c68-4dbf-8614-90ab0a69f0d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70325f8-9f61-4b4f-ad80-14dfd75ae443]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:41 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-bf5b3168-370e-4692-98b1-82285ae4437c tempest-CreateVolumesFromSnapshotTest-419078405 None] Created volume successfully. Jul 21 19:19:41 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 Jul 21 19:19:41 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:41 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4" returned: 0 in 0.343s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:41 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 1G Jul 21 19:19:41 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:42 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 1G" returned: 0 in 0.390s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:42 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 Jul 21 19:19:42 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:42 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583" returned: 0 in 0.268s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:42 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 is being set with open permissions: ugo+rw Jul 21 19:19:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:42 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 Jul 21 19:19:42 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-12858325-e4ec-4b8e-81db-25105777997f-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-12858325-e4ec-4b8e-81db-25105777997f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-quobyte-12858325-e4ec-4b8e-81db-25105777997f" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:42 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-12858325-e4ec-4b8e-81db-25105777997f" acquired by "delete_volume" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:42 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[db702643-0a6e-438c-9c94-9b7be4caeda5]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12858325-e4ec-4b8e-81db-25105777997f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:42 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583" returned: 0 in 0.274s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:42 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:UPDATE=288,cinder:SELECT=197,cinder:DELETE=35,cinder:INSERT=75 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:19:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:42 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.info Jul 21 19:19:42 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:42 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12858325-e4ec-4b8e-81db-25105777997f Jul 21 19:19:42 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:43 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.info" returned: 0 in 0.267s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:43 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.info is being set with open permissions: ugo+rw Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:43 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.info Jul 21 19:19:43 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:43 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12858325-e4ec-4b8e-81db-25105777997f" returned: 0 in 0.365s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12858325-e4ec-4b8e-81db-25105777997f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:43 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12858325-e4ec-4b8e-81db-25105777997f Jul 21 19:19:43 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:43 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.info" returned: 0 in 0.249s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.916s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.748s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39738382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd5c551-dd30-4be1-8132-cb4fcadb0157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726d600e5eaa40059fcc9882bbfd1d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:40Z,use_quota=True,user_id='d202e5a031a14a99b430f1c9e7068b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Creating volume 7dd5c551-dd30-4be1-8132-cb4fcadb0157 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:43 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:43 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-12858325-e4ec-4b8e-81db-25105777997f" returned: 0 in 0.242s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:43 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157 1073741824 Jul 21 19:19:43 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-12858325-e4ec-4b8e-81db-25105777997f" released by "delete_volume" :: held 0.656s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:43 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f98947c6-cb23-482e-b36c-9335104823aa tempest-ProjectMemberTests-1585065700 None] Create snapshot completed successfully Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Created reservations ['2bc71f7e-ebd5-4f68-b8c5-045c6018b9a2', '975956b2-81ad-4aa4-b2c4-062a62f568cb', 'd6ff151b-4175-4a6a-9ee9-9a65708ae8e8', '0ccb6836-0acb-4ecc-bbb3-0eaa9b2961ce'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:43 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:43 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-cff76c4a-01ff-4c98-8654-e06b7005a583-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-cff76c4a-01ff-4c98-8654-e06b7005a583-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-cff76c4a-01ff-4c98-8654-e06b7005a583" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-cff76c4a-01ff-4c98-8654-e06b7005a583" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Deleting offline snapshot cff76c4a-01ff-4c98-8654-e06b7005a583 of volume dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] snapshot_file for this snap is: volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd9780c-6984-44f1-9c09-066ae54f89c3]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-a549392f-b898-4709-b4c7-89c92047fa10-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:43 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.299s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:43 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Deleted volume successfully. Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-a549392f-b898-4709-b4c7-89c92047fa10-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:43 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 Jul 21 19:19:43 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-55bc638d-7e07-4341-9745-61d48411097b tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-12858325-e4ec-4b8e-81db-25105777997f-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:43 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-quobyte-a549392f-b898-4709-b4c7-89c92047fa10" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:43 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157 1073741824" returned: 0 in 0.583s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-a549392f-b898-4709-b4c7-89c92047fa10" acquired by "delete_volume" :: waited 0.025s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfb940f-d00e-41bc-9054-a16d5db4bfea]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a549392f-b898-4709-b4c7-89c92047fa10 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:44 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157 Jul 21 19:19:44 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:44 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a549392f-b898-4709-b4c7-89c92047fa10 Jul 21 19:19:44 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:44 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583" returned: 0 in 0.488s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[940c4078-5a1d-469c-acb0-da05482c2c7e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:44 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157" returned: 0 in 0.264s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.248s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd9c09e-8fca-49b0-b6e8-2eb8490aac2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fdc7a51-09b8-46d1-85c5-f9f7dcd6ad34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] Creating offline snapshot 3e246163-4ed9-4d0b-90fe-826ca8786187 of volume 140c9dcb-aa10-42b8-b447-4abc8df6fd9c {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:44 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Volume volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157 (7dd5c551-dd30-4be1-8132-cb4fcadb0157): created successfully Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fdc7a51-09b8-46d1-85c5-f9f7dcd6ad34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Flow 'volume_create_manager' (eac05cc1-1bad-4a3f-8cb1-8d6c06b2f376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc6f07a-8495-46d6-9bb8-d7c75a50ac91]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:44 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 Jul 21 19:19:44 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:44 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9c285f54-d693-4569-b82f-c302c446f271 tempest-ProjectReaderTests-370653668 None] Created volume successfully. Jul 21 19:19:44 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a549392f-b898-4709-b4c7-89c92047fa10" returned: 0 in 0.428s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a549392f-b898-4709-b4c7-89c92047fa10 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:44 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a549392f-b898-4709-b4c7-89c92047fa10 Jul 21 19:19:44 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:44 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c Jul 21 19:19:44 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:44 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4" returned: 0 in 0.415s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:44 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 Jul 21 19:19:44 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:44 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a549392f-b898-4709-b4c7-89c92047fa10" returned: 0 in 0.311s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-a549392f-b898-4709-b4c7-89c92047fa10" released by "delete_volume" :: held 0.803s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Created reservations ['6e8de4e5-f351-4709-ba2f-bdaeace2ea9c', '539fa5f9-9707-43bc-9f3f-8e5cb82a063a', '07b8283f-3925-4cf0-a6c2-ab34d274e864', '39c86c86-6d51-426d-93bc-3420f26319ea'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:44 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c" returned: 0 in 0.520s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:44 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 1G Jul 21 19:19:44 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Acquiring lock "cinder-7dd5c551-dd30-4be1-8132-cb4fcadb0157-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:45 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:45 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Lock "cinder-7dd5c551-dd30-4be1-8132-cb4fcadb0157-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Acquiring lock "cinder-quobyte-7dd5c551-dd30-4be1-8132-cb4fcadb0157" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Lock "cinder-quobyte-7dd5c551-dd30-4be1-8132-cb4fcadb0157" acquired by "delete_volume" :: waited 0.029s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d3c402-0887-4c74-97a8-b68e89a0358b]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-quobyte-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:45 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855" acquired by "delete_volume" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583" returned: 0 in 0.635s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[52095140-1655-44d8-823f-48775814cc5d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157 Jul 21 19:19:45 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583 Jul 21 19:19:45 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.462s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:45 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Deleted volume successfully. Jul 21 19:19:45 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 1G" returned: 0 in 0.567s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c1f8058d-0c52-4afd-aa22-d74d24321792 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-a549392f-b898-4709-b4c7-89c92047fa10-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:45 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855 Jul 21 19:19:45 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 Jul 21 19:19:45 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4.cff76c4a-01ff-4c98-8654-e06b7005a583" returned: 0 in 0.321s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157" returned: 0 in 0.492s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-cff76c4a-01ff-4c98-8654-e06b7005a583" released by "_delete_snapshot" :: held 1.991s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4" released by "delete_snapshot" :: held 2.023s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:45 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157 Jul 21 19:19:45 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Created reservations ['9b4a9b81-abab-4826-a153-36f2db2890bd', '917ef9ff-ed3a-495a-9d76-ba011e7166a0', '77410ff7-2940-4b6b-bdc7-e1b916e6e186', '0d1d212c-c71c-4e74-95d6-8ba9c2804d80'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:45 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855" returned: 0 in 0.485s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855 Jul 21 19:19:45 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Delete snapshot completed successfully. Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c579b2e8-c840-438d-bf13-7aa3aed6bdd1 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-cff76c4a-01ff-4c98-8654-e06b7005a583-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:45 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187" returned: 0 in 0.418s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 is being set with open permissions: ugo+rw Jul 21 19:19:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 Jul 21 19:19:45 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:46 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-7dd5c551-dd30-4be1-8132-cb4fcadb0157" returned: 0 in 0.341s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:46 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Lock "cinder-quobyte-7dd5c551-dd30-4be1-8132-cb4fcadb0157" released by "delete_volume" :: held 0.928s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855" returned: 0 in 0.294s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855" released by "delete_volume" :: held 0.838s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Created reservations ['f1da15cf-066b-4f1a-ae94-675257ae1321', 'c5ca23aa-0c75-4cf9-91b4-037860978b16', '49777f78-d6d2-498f-bde1-3094ea57bd87', '7bc48c86-6d73-4639-be4f-ca06d096d159'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:46 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187" returned: 0 in 0.302s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Created reservations ['24163866-8e5f-47bb-9635-b8e6984c4a69', '35ce969d-473e-4c76-8dd6-f051d8bad0dc', '3f2f3a4b-fb77-4e41-8a5a-75faf8b4538f', '3017690b-799e-4861-b71f-6126ee2fc364'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:46 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.info Jul 21 19:19:46 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:46 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:46 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-e8e94c43-603d-4ab1-b303-f20ebaf74323-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:46 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:46 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-e8e94c43-603d-4ab1-b303-f20ebaf74323-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-quobyte-e8e94c43-603d-4ab1-b303-f20ebaf74323" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-e8e94c43-603d-4ab1-b303-f20ebaf74323" acquired by "delete_volume" :: waited 0.034s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f63a48-6912-438a-8d9d-57dc02ecefc6]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8e94c43-603d-4ab1-b303-f20ebaf74323 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:46 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.info" returned: 0 in 0.388s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:46 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.info is being set with open permissions: ugo+rw Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:46 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.340s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:46 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Deleted volume successfully. Jul 21 19:19:46 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.info Jul 21 19:19:46 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5a43a225-2544-443f-8a58-e5a2f443cee5 tempest-ProjectReaderTests-370653668 None] Lock "cinder-7dd5c551-dd30-4be1-8132-cb4fcadb0157-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:46 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8e94c43-603d-4ab1-b303-f20ebaf74323 Jul 21 19:19:46 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:46 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.351s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:46 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Deleted volume successfully. Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-ff9472e1-9fce-4103-b82a-3ed162c7bac0 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-a3dfdc7a-9845-4b55-9b2e-9dcbf4019855-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:46 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.info" returned: 0 in 0.293s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.624s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:46 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-b5bcac1c-0da8-4220-9b9f-efd772557dd7 tempest-ProjectReaderTests-911164663 None] Create snapshot completed successfully Jul 21 19:19:47 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8e94c43-603d-4ab1-b303-f20ebaf74323" returned: 0 in 0.421s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8e94c43-603d-4ab1-b303-f20ebaf74323 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:47 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8e94c43-603d-4ab1-b303-f20ebaf74323 Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:47 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4" acquired by "delete_volume" :: waited 0.014s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b86a63-4a1d-4529-b6d8-2abbc57e74ec]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:47 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 Jul 21 19:19:47 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:47 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e8e94c43-603d-4ab1-b303-f20ebaf74323" returned: 0 in 0.323s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-e8e94c43-603d-4ab1-b303-f20ebaf74323" released by "delete_volume" :: held 0.793s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Created reservations ['af046249-4bf1-486b-9bf8-fcca76371907', '2d3cfcb7-62c1-487a-9016-5a2286aa5b68', 'e5b8e0b3-0cb6-4ec1-8781-87b8b949ae2b', 'bc57f227-afe4-4ad2-a2fd-c93b78897bc6'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:47 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:47 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:47 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-3e246163-4ed9-4d0b-90fe-826ca8786187-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4" returned: 0 in 0.468s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Lock "cinder-3e246163-4ed9-4d0b-90fe-826ca8786187-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-140c9dcb-aa10-42b8-b447-4abc8df6fd9c" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:47 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4 Jul 21 19:19:47 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-60e7181b-b259-4c51-a654-691509ab9742-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-140c9dcb-aa10-42b8-b447-4abc8df6fd9c" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-3e246163-4ed9-4d0b-90fe-826ca8786187" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-60e7181b-b259-4c51-a654-691509ab9742-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-3e246163-4ed9-4d0b-90fe-826ca8786187" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Deleting offline snapshot 3e246163-4ed9-4d0b-90fe-826ca8786187 of volume 140c9dcb-aa10-42b8-b447-4abc8df6fd9c {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] snapshot_file for this snap is: volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1e87ed-34ad-4d2f-9aac-29e59396bfb4]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:47 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.407s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-quobyte-60e7181b-b259-4c51-a654-691509ab9742" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:47 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Deleted volume successfully. Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-60e7181b-b259-4c51-a654-691509ab9742" acquired by "delete_volume" :: waited 0.032s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-eab52b3b-32d3-42fa-9c23-5a6d6357b7f3 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-e8e94c43-603d-4ab1-b303-f20ebaf74323-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4abcb1-1304-474c-bc64-78a84cd8608b]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-60e7181b-b259-4c51-a654-691509ab9742 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:48 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 Jul 21 19:19:48 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:48 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Flow 'volume_create_manager' (d1e8c4b6-60ee-4a04-b813-f96bf4b4fa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ac216e-8bc1-4aae-8050-cbe9334e5abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4" returned: 0 in 0.466s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:48 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-60e7181b-b259-4c51-a654-691509ab9742 Jul 21 19:19:48 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ac216e-8bc1-4aae-8050-cbe9334e5abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1030348397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726d600e5eaa40059fcc9882bbfd1d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:48Z,use_quota=True,user_id='d202e5a031a14a99b430f1c9e7068b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d8ae36-5381-4fa9-b2e9-2151001e61d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d8ae36-5381-4fa9-b2e9-2151001e61d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b65173-83eb-486f-aeec-48f5288bbf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b65173-83eb-486f-aeec-48f5288bbf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6', 'volume_name': 'volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407bc743-22b6-434a-ab03-71a4c3e5b0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407bc743-22b6-434a-ab03-71a4c3e5b0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f590ee0-52b9-4b05-aefe-58a2ea363196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:48 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Volume 5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6', 'volume_size': 1} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1030348397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726d600e5eaa40059fcc9882bbfd1d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:48Z,use_quota=True,user_id='d202e5a031a14a99b430f1c9e7068b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Creating volume 5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:48 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4" released by "delete_volume" :: held 1.082s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:48 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6 1073741824 Jul 21 19:19:48 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Created reservations ['94ce17b7-1111-4db8-bf09-6ccad9898f4d', 'c9cadac2-adbb-4ba0-a95e-27d530ec30d6', 'c88293bc-3c21-4eb8-a32b-ed9def142c7a', '614947b5-12dc-412f-8921-8f8321cfc7aa'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:48 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:48 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:48 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187" returned: 0 in 0.554s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c8819b-b3e1-4b07-97fc-d1024c28654b]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:48 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-60e7181b-b259-4c51-a654-691509ab9742" returned: 0 in 0.490s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-60e7181b-b259-4c51-a654-691509ab9742 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:48 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-60e7181b-b259-4c51-a654-691509ab9742 Jul 21 19:19:48 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:48 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c Jul 21 19:19:48 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:48 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.272s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:48 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Deleted volume successfully. Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a3f93546-727b-4903-9261-2c304c5fb050 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-dcb81ef9-2b77-4bdc-a596-b6e7e136b9e4-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:48 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-60e7181b-b259-4c51-a654-691509ab9742" returned: 0 in 0.286s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-60e7181b-b259-4c51-a654-691509ab9742" released by "delete_volume" :: held 0.826s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:48 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6 1073741824" returned: 0 in 0.614s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Created reservations ['6d3d9170-ccdf-4974-981c-800802474c62', '668cd3ed-500f-4e2a-9dbf-ea56b36509cc', '76ecfa5c-b2d3-46bc-9c37-8285893725b4', '85400ab9-a086-410d-9a34-ba817b0a338a'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:48 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6 Jul 21 19:19:48 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:48 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:48 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:48 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c" returned: 0 in 0.521s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:49 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 Jul 21 19:19:49 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-38d8142e-3767-4482-9a6c-16b7b0102c1d-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-38d8142e-3767-4482-9a6c-16b7b0102c1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-quobyte-b83503fc-bbad-4a2a-8b47-88ece3ad691f" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-b83503fc-bbad-4a2a-8b47-88ece3ad691f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-quobyte-38d8142e-3767-4482-9a6c-16b7b0102c1d" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-38d8142e-3767-4482-9a6c-16b7b0102c1d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Deleting offline snapshot 38d8142e-3767-4482-9a6c-16b7b0102c1d of volume b83503fc-bbad-4a2a-8b47-88ece3ad691f {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] snapshot_file for this snap is: volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ef6afd-9161-47d3-83fd-ff6a9660d3fa]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:49 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6" returned: 0 in 0.359s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=261,cinder:INSERT=91,cinder:UPDATE=331,cinder:DELETE=23 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f590ee0-52b9-4b05-aefe-58a2ea363196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42467da-377d-484b-b173-adbb65d52191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:49 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d Jul 21 19:19:49 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:49 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Volume volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6 (5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6): created successfully Jul 21 19:19:49 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42467da-377d-484b-b173-adbb65d52191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Flow 'volume_create_manager' (d1e8c4b6-60ee-4a04-b813-f96bf4b4fa85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.376s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:49 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Deleted volume successfully. Jul 21 19:19:49 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f3b46bb3-eb06-4919-b5ab-51f6de5bdce3 tempest-ProjectReaderTests-370653668 None] Created volume successfully. Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-bf9d445b-f615-4815-9a8d-d8f48d52c3ec tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-60e7181b-b259-4c51-a654-691509ab9742-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:49 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187" returned: 0 in 0.437s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:49 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187 Jul 21 19:19:49 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:49 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d" returned: 0 in 0.441s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d59598-ecba-4f75-83ed-0fffc457106a]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:49 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c.3e246163-4ed9-4d0b-90fe-826ca8786187" returned: 0 in 0.308s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-3e246163-4ed9-4d0b-90fe-826ca8786187" released by "_delete_snapshot" :: held 1.981s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-140c9dcb-aa10-42b8-b447-4abc8df6fd9c" released by "delete_snapshot" :: held 2.025s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:49 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f Jul 21 19:19:49 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Created reservations ['b2cb66e4-e51f-4cba-b37a-93416700ad12', 'c91d5be0-56b2-49e0-915b-86ed2711626f', '9a957cae-1339-4fa3-8241-324b5a08963b', '5e6f6ed3-9644-4984-84ae-e26d84cae4d3'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (420eff70-64c3-4183-87b6-8a941c93e9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84578e72-3d49-4d8f-9fb8-72ccd28fe0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84578e72-3d49-4d8f-9fb8-72ccd28fe0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1037580816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a3f60c-4ebe-4099-a22b-fe3679a1663e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:50Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4755dd8-71ef-4ea6-838c-c31ba19ae86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4755dd8-71ef-4ea6-838c-c31ba19ae86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810fb0b9-3815-46d6-86ac-395f233a3f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810fb0b9-3815-46d6-86ac-395f233a3f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a3f60c-4ebe-4099-a22b-fe3679a1663e', 'volume_name': 'volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c23b00e-2757-4127-9388-aa0da1d2a5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c23b00e-2757-4127-9388-aa0da1d2a5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4b7e71-c79d-417b-b0de-8f2842efc1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:49 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Volume 46a3f60c-4ebe-4099-a22b-fe3679a1663e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e', 'volume_size': 1} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1037580816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a3f60c-4ebe-4099-a22b-fe3679a1663e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:50Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Creating volume 46a3f60c-4ebe-4099-a22b-fe3679a1663e {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:49 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:50 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e 1073741824 Jul 21 19:19:50 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:50 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Delete snapshot completed successfully. Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-157b9ada-545c-4608-b921-8bce8a6e890b tempest-ProjectReaderTests-911164663 None] Lock "cinder-3e246163-4ed9-4d0b-90fe-826ca8786187-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:50 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f" returned: 0 in 0.441s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:50 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d Jul 21 19:19:50 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Acquiring lock "cinder-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Lock "cinder-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Acquiring lock "cinder-quobyte-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Lock "cinder-quobyte-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6" acquired by "delete_volume" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f9cd0f-8b91-47b5-8778-02cb229a3596]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:50 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6 Jul 21 19:19:50 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:50 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e 1073741824" returned: 0 in 0.495s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:50 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d" returned: 0 in 0.413s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:50 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d Jul 21 19:19:50 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:50 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e Jul 21 19:19:50 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:50 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6" returned: 0 in 0.377s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:50 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6 Jul 21 19:19:50 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:50 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f.38d8142e-3767-4482-9a6c-16b7b0102c1d" returned: 0 in 0.285s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:50 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e" returned: 0 in 0.310s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-38d8142e-3767-4482-9a6c-16b7b0102c1d" released by "_delete_snapshot" :: held 1.725s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-b83503fc-bbad-4a2a-8b47-88ece3ad691f" released by "delete_snapshot" :: held 1.754s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4b7e71-c79d-417b-b0de-8f2842efc1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e22cc6-e6d0-4692-9c15-89fedfc86486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:50 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Volume volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e (46a3f60c-4ebe-4099-a22b-fe3679a1663e): created successfully Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e22cc6-e6d0-4692-9c15-89fedfc86486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (420eff70-64c3-4183-87b6-8a941c93e9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:50 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6" returned: 0 in 0.271s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Lock "cinder-quobyte-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6" released by "delete_volume" :: held 0.695s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:50 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-da5481f1-b3eb-49c9-8af5-f9b36d19de93 tempest-ProjectMemberTests-1585065700 None] Created volume successfully. Jul 21 19:19:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-140c9dcb-aa10-42b8-b447-4abc8df6fd9c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Created reservations ['0f37a4a9-af3f-43f8-9807-4058c3c1485c', '621b0681-3742-491e-a6e1-99ea7beaa9b5', '876665c0-4194-4aa7-94ca-f46257ae9931', '15ec5dec-d20c-457c-8fe7-f08dfb0153f6'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Lock "cinder-140c9dcb-aa10-42b8-b447-4abc8df6fd9c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Created reservations ['f4d96ef8-0fec-499b-aac3-728197f23203', 'be27ca2e-a087-4f46-add8-5711a5df5264', '273c2742-e871-4f76-a9d7-e58100681ed2', 'c235e12f-5964-48ed-915a-f540e942ede8'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-140c9dcb-aa10-42b8-b447-4abc8df6fd9c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-140c9dcb-aa10-42b8-b447-4abc8df6fd9c" acquired by "delete_volume" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:51 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Delete snapshot completed successfully. Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-919dc172-19d1-45bb-a8b6-934acd9139f9 tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-38d8142e-3767-4482-9a6c-16b7b0102c1d-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8460c928-3888-4311-ae6f-d21e0a409660]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:51 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:51 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-b83503fc-bbad-4a2a-8b47-88ece3ad691f-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:51 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c Jul 21 19:19:51 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-b83503fc-bbad-4a2a-8b47-88ece3ad691f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "cinder-quobyte-b83503fc-bbad-4a2a-8b47-88ece3ad691f" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-b83503fc-bbad-4a2a-8b47-88ece3ad691f" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed389ff7-d298-42db-abff-2fdc091a9623]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:51 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.313s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:51 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Deleted volume successfully. Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a6f6aba3-4f5b-446a-b178-767b5fe76656 tempest-ProjectReaderTests-370653668 None] Lock "cinder-5a9e5eb3-ffdf-422b-ac2d-cca1235c8fc6-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:51 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f Jul 21 19:19:51 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:51 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c" returned: 0 in 0.441s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:51 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c Jul 21 19:19:51 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:51 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f" returned: 0 in 0.415s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:51 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f Jul 21 19:19:51 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:51 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-140c9dcb-aa10-42b8-b447-4abc8df6fd9c" returned: 0 in 0.291s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-140c9dcb-aa10-42b8-b447-4abc8df6fd9c" released by "delete_volume" :: held 0.804s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Flow 'volume_create_manager' (80f3ff82-9e98-4178-97c4-c5c542d1c39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:51 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5520e5-5e41-48fb-a2a6-d0a3c45f6531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5520e5-5e41-48fb-a2a6-d0a3c45f6531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-633118613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c53f8c-f4fa-4486-8b0c-909069277039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726d600e5eaa40059fcc9882bbfd1d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:52Z,use_quota=True,user_id='d202e5a031a14a99b430f1c9e7068b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56edc972-281b-4b14-8800-29711c313c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56edc972-281b-4b14-8800-29711c313c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462606d2-44b9-4820-9709-d8583a670a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462606d2-44b9-4820-9709-d8583a670a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9c53f8c-f4fa-4486-8b0c-909069277039', 'volume_name': 'volume-e9c53f8c-f4fa-4486-8b0c-909069277039', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b506e54-b3e4-42d3-a71c-7139664b0257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b506e54-b3e4-42d3-a71c-7139664b0257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2cdf047-61d0-400d-979b-ce6a959fcf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:52 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Volume e9c53f8c-f4fa-4486-8b0c-909069277039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9c53f8c-f4fa-4486-8b0c-909069277039', 'volume_size': 1} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-633118613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c53f8c-f4fa-4486-8b0c-909069277039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726d600e5eaa40059fcc9882bbfd1d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:52Z,use_quota=True,user_id='d202e5a031a14a99b430f1c9e7068b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Creating volume e9c53f8c-f4fa-4486-8b0c-909069277039 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:52 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e9c53f8c-f4fa-4486-8b0c-909069277039 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:52 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e9c53f8c-f4fa-4486-8b0c-909069277039 1073741824 Jul 21 19:19:52 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:52 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-b83503fc-bbad-4a2a-8b47-88ece3ad691f" returned: 0 in 0.326s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-quobyte-b83503fc-bbad-4a2a-8b47-88ece3ad691f" released by "delete_volume" :: held 0.850s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Created reservations ['2f08e179-0763-4da8-b516-1423ca7390b5', '40cde621-cf47-4f75-9c09-aeac4d470630', 'b58a142e-c63d-4652-94b1-e4149b1f4ffd', 'd1747725-f5ac-4739-8ab5-825b031d26d6'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Created reservations ['d90785fe-766c-48fd-accb-3c0fef996b1c', 'f70b2de2-ce3c-46d4-9d98-77508c4f2429', '395bbcc5-5909-4787-a82b-2844299dfa61', 'a94e88b0-c18a-40f9-a0d0-62ed841198db'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:52 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:52 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:52 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:52 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:52 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e9c53f8c-f4fa-4486-8b0c-909069277039 1073741824" returned: 0 in 0.591s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:52 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.320s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:52 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Deleted volume successfully. Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e9c53f8c-f4fa-4486-8b0c-909069277039 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-e78116d9-f6b2-4ac1-8581-443c2a50b6ac tempest-ProjectReaderTests-911164663 None] Lock "cinder-140c9dcb-aa10-42b8-b447-4abc8df6fd9c-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:52 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e9c53f8c-f4fa-4486-8b0c-909069277039 Jul 21 19:19:52 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:52 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.317s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:52 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Deleted volume successfully. Jul 21 19:19:52 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-490b20cb-696c-4d5a-bb98-89663eb5dd8f tempest-CreateVolumesFromSnapshotTest-419078405 None] Lock "cinder-b83503fc-bbad-4a2a-8b47-88ece3ad691f-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:53 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e9c53f8c-f4fa-4486-8b0c-909069277039" returned: 0 in 0.301s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.761s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2cdf047-61d0-400d-979b-ce6a959fcf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9c53f8c-f4fa-4486-8b0c-909069277039', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680e16c6-0a2d-43d6-bd10-c80564f5fddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] Creating offline snapshot b0690ee6-6459-452b-a492-7ba748f25b6b of volume 46a3f60c-4ebe-4099-a22b-fe3679a1663e {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:53 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Volume volume-e9c53f8c-f4fa-4486-8b0c-909069277039 (e9c53f8c-f4fa-4486-8b0c-909069277039): created successfully Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680e16c6-0a2d-43d6-bd10-c80564f5fddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Flow 'volume_create_manager' (80f3ff82-9e98-4178-97c4-c5c542d1c39c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[294f154b-d9d1-4ea6-acf1-9f5c50c3968b]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:53 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d2ab1ad6-276a-44dc-bbfe-97aeaa933396 tempest-ProjectReaderTests-370653668 None] Created volume successfully. Jul 21 19:19:53 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e Jul 21 19:19:53 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:53 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e" returned: 0 in 0.395s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:53 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b 1G Jul 21 19:19:53 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Flow 'volume_create_manager' (423df63b-924e-48b2-8c84-53627d1964e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635d3d77-5919-4ca8-9234-609039f38f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635d3d77-5919-4ca8-9234-609039f38f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1569289868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6be045-3fe7-47fa-a2b7-8dd55db8eb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97f7701be0144328fcd9e74a3439495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:54Z,use_quota=True,user_id='93b6fc418e594de8a51459511ada5ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94ff871-7e9d-499d-bc80-0e3fdfdedb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94ff871-7e9d-499d-bc80-0e3fdfdedb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ea66a6-db65-4382-a713-ac86b77459d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ea66a6-db65-4382-a713-ac86b77459d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c6be045-3fe7-47fa-a2b7-8dd55db8eb91', 'volume_name': 'volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0062ceb5-e3b2-4027-a3e4-85a71f3022a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0062ceb5-e3b2-4027-a3e4-85a71f3022a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2da452-3aee-48dc-a9f0-5246ef386793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:53 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Volume 3c6be045-3fe7-47fa-a2b7-8dd55db8eb91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91', 'volume_size': 1} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:53 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b 1G" returned: 0 in 0.499s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:53 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:54 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b Jul 21 19:19:54 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Acquiring lock "cinder-e9c53f8c-f4fa-4486-8b0c-909069277039-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Lock "cinder-e9c53f8c-f4fa-4486-8b0c-909069277039-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Acquiring lock "cinder-quobyte-e9c53f8c-f4fa-4486-8b0c-909069277039" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Lock "cinder-quobyte-e9c53f8c-f4fa-4486-8b0c-909069277039" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[66de988f-c5fd-44bd-bd4d-75d0a950cb26]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e9c53f8c-f4fa-4486-8b0c-909069277039 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:54 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e9c53f8c-f4fa-4486-8b0c-909069277039 Jul 21 19:19:54 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:54 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b" returned: 0 in 0.345s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:54 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b is being set with open permissions: ugo+rw Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:54 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b Jul 21 19:19:54 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:54 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b" returned: 0 in 0.255s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:54 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e9c53f8c-f4fa-4486-8b0c-909069277039" returned: 0 in 0.444s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e9c53f8c-f4fa-4486-8b0c-909069277039 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:54 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e9c53f8c-f4fa-4486-8b0c-909069277039 Jul 21 19:19:54 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:54 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.info Jul 21 19:19:54 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:54 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-e9c53f8c-f4fa-4486-8b0c-909069277039" returned: 0 in 0.270s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Lock "cinder-quobyte-e9c53f8c-f4fa-4486-8b0c-909069277039" released by "delete_volume" :: held 0.755s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Created reservations ['9fe32a7a-8b24-4f97-8d4c-155e61683498', '85144734-182b-4e67-99e1-de67348f858c', '9b3ad106-4350-4c72-9307-a6312b93859d', '4c2b58ff-176d-46ec-a90b-bcd3c5cfae41'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:54 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.info" returned: 0 in 0.335s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:54 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.info is being set with open permissions: ugo+rw Jul 21 19:19:54 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:55 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.info Jul 21 19:19:55 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:55 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:55 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:55 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.info" returned: 0 in 0.321s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.379s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1569289868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6be045-3fe7-47fa-a2b7-8dd55db8eb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97f7701be0144328fcd9e74a3439495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:54Z,use_quota=True,user_id='93b6fc418e594de8a51459511ada5ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Creating volume 3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:55 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:55 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.291s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:55 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Deleted volume successfully. Jul 21 19:19:55 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 1073741824 Jul 21 19:19:55 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:55 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a2aa22fe-28ea-4c4a-b3cc-1e086f5ef715 tempest-ProjectMemberTests-1585065700 None] Create snapshot completed successfully Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9d8f5d49-9f02-4387-8748-c25c80b2493c tempest-ProjectReaderTests-370653668 None] Lock "cinder-e9c53f8c-f4fa-4486-8b0c-909069277039-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:55 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 1073741824" returned: 0 in 0.629s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:55 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:56 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 Jul 21 19:19:56 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:56 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91" returned: 0 in 0.256s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2da452-3aee-48dc-a9f0-5246ef386793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2a1fd3-b0af-481e-8383-b64e4107e65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:56 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Volume volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 (3c6be045-3fe7-47fa-a2b7-8dd55db8eb91): created successfully Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2a1fd3-b0af-481e-8383-b64e4107e65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Flow 'volume_create_manager' (423df63b-924e-48b2-8c84-53627d1964e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:56 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-1552d581-91e0-4935-9522-ca533a286ac7 tempest-ProjectReaderTests-911164663 None] Created volume successfully. Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-b0690ee6-6459-452b-a492-7ba748f25b6b-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Lock "cinder-b0690ee6-6459-452b-a492-7ba748f25b6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-46a3f60c-4ebe-4099-a22b-fe3679a1663e" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-46a3f60c-4ebe-4099-a22b-fe3679a1663e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-b0690ee6-6459-452b-a492-7ba748f25b6b" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-b3c5049c-80f6-440f-92b4-09c30528ea62 tempest-ProjectAdminTests-493246933 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.754280090332, 'free_capacity_gb': 1775.754280090332, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87487) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-b0690ee6-6459-452b-a492-7ba748f25b6b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Deleting offline snapshot b0690ee6-6459-452b-a492-7ba748f25b6b of volume 46a3f60c-4ebe-4099-a22b-fe3679a1663e {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] snapshot_file for this snap is: volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6799f0ee-9eb0-4409-baf8-73dcaee2343c]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:56 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:56 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b Jul 21 19:19:56 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:57 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b" returned: 0 in 0.455s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:57 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd89fb4f-9182-412b-8f4c-69e9d85a8fad]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:57 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e Jul 21 19:19:57 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:57 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] Creating offline snapshot cfc3d8c9-6f47-490e-a6a4-9c011fea8717 of volume 3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:57 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[91644ea9-7380-40be-9461-8187193a937f]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:57 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 Jul 21 19:19:57 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:57 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e" returned: 0 in 0.557s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:57 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b Jul 21 19:19:57 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:57 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91" returned: 0 in 0.523s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:57 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:57 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 1G Jul 21 19:19:57 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:58 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b" returned: 0 in 0.437s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:58 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b Jul 21 19:19:58 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:58 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e.b0690ee6-6459-452b-a492-7ba748f25b6b" returned: 0 in 0.299s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-b0690ee6-6459-452b-a492-7ba748f25b6b" released by "_delete_snapshot" :: held 1.892s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-46a3f60c-4ebe-4099-a22b-fe3679a1663e" released by "delete_snapshot" :: held 1.928s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:58 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 1G" returned: 0 in 0.584s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:58 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 Jul 21 19:19:58 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Created reservations ['27fd9a48-7c11-4ad8-8b5f-5631201799e2', '0b868bb0-73cf-472b-98f5-f94f10b7ceb1', '037d18b1-e867-45c5-99c5-84aa5436783a', 'c572d5a4-ab65-4bba-b7f7-f191213b7787'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:58 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Delete snapshot completed successfully. Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f1187171-320e-4df4-9983-2d4663a11eeb tempest-ProjectMemberTests-1585065700 None] Lock "cinder-b0690ee6-6459-452b-a492-7ba748f25b6b-delete_snapshot" released by "delete_snapshot" :: held 2.146s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-46a3f60c-4ebe-4099-a22b-fe3679a1663e-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Lock "cinder-46a3f60c-4ebe-4099-a22b-fe3679a1663e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:58 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717" returned: 0 in 0.352s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:58 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 is being set with open permissions: ugo+rw Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:58 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 Jul 21 19:19:58 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-46a3f60c-4ebe-4099-a22b-fe3679a1663e" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-46a3f60c-4ebe-4099-a22b-fe3679a1663e" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b826174-27d6-4e84-a6cf-8f0aba6c7614]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:58 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:58 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e Jul 21 19:19:58 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:59 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717" returned: 0 in 0.328s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:59 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.info Jul 21 19:19:59 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:59 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e" returned: 0 in 0.405s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:59 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e Jul 21 19:19:59 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:59 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.info" returned: 0 in 0.292s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:59 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.info is being set with open permissions: ugo+rw Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:59 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.info Jul 21 19:19:59 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:59 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-46a3f60c-4ebe-4099-a22b-fe3679a1663e" returned: 0 in 0.300s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-46a3f60c-4ebe-4099-a22b-fe3679a1663e" released by "delete_volume" :: held 0.771s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Created reservations ['5388f0f8-7825-423b-9c44-f264a58e159b', '97214958-4757-4e94-9a12-9ed8279495da', 'f5307015-f385-4635-afcb-1965527c1dc3', '32ca3099-e791-4b16-a219-fbf0eca5c265'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:59 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.info" returned: 0 in 0.303s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.497s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:59 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-fef0ec80-16a4-4d4f-a4d5-34f226425076 tempest-ProjectReaderTests-911164663 None] Create snapshot completed successfully Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:59 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:59 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:19:59 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:00 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.279s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:00 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Deleted volume successfully. Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-32a99ea4-8130-4622-8807-44a41e2a4dbc tempest-ProjectMemberTests-1585065700 None] Lock "cinder-46a3f60c-4ebe-4099-a22b-fe3679a1663e-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (afdbd8af-d542-4df5-862a-f5ca77ab5c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8156c1-2597-4a2c-a9c7-fcee1e2257be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8156c1-2597-4a2c-a9c7-fcee1e2257be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490011864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0500afb-663f-476c-9f97-a6afaaad81fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:00Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9a7c7b-4773-40c7-8868-e9ed5ead7d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9a7c7b-4773-40c7-8868-e9ed5ead7d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48bc6b1-237c-43a4-b748-95154af00585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48bc6b1-237c-43a4-b748-95154af00585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0500afb-663f-476c-9f97-a6afaaad81fc', 'volume_name': 'volume-f0500afb-663f-476c-9f97-a6afaaad81fc', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c276ae33-b1ab-4fe5-bd13-e4bd4949b67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c276ae33-b1ab-4fe5-bd13-e4bd4949b67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc835873-e3a5-4ee1-8d35-b8fb3c85b270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:00 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Volume f0500afb-663f-476c-9f97-a6afaaad81fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0500afb-663f-476c-9f97-a6afaaad81fc', 'volume_size': 1} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490011864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0500afb-663f-476c-9f97-a6afaaad81fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:00Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Creating volume f0500afb-663f-476c-9f97-a6afaaad81fc {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:00 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-cfc3d8c9-6f47-490e-a6a4-9c011fea8717-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:00 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc 1073741824 Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Lock "cinder-cfc3d8c9-6f47-490e-a6a4-9c011fea8717-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:00 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-cfc3d8c9-6f47-490e-a6a4-9c011fea8717" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-cfc3d8c9-6f47-490e-a6a4-9c011fea8717" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Deleting offline snapshot cfc3d8c9-6f47-490e-a6a4-9c011fea8717 of volume 3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] snapshot_file for this snap is: volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c728279a-867d-445f-b0e9-11d93973e207]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:00 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:00 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 Jul 21 19:20:00 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:01 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc 1073741824" returned: 0 in 0.543s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:01 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717" returned: 0 in 0.456s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21889b4-91ba-4c7d-bf51-cb1c8fe2fe1e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:01 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc Jul 21 19:20:01 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:01 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 Jul 21 19:20:01 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:01 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc" returned: 0 in 0.259s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc835873-e3a5-4ee1-8d35-b8fb3c85b270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0500afb-663f-476c-9f97-a6afaaad81fc', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3aa4cc-0ec8-4f4b-9101-51f0eb7ce9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:01 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Volume volume-f0500afb-663f-476c-9f97-a6afaaad81fc (f0500afb-663f-476c-9f97-a6afaaad81fc): created successfully Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3aa4cc-0ec8-4f4b-9101-51f0eb7ce9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (afdbd8af-d542-4df5-862a-f5ca77ab5c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:01 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a9fab7c3-a2ef-423e-bd22-f37f41acf348 tempest-ProjectMemberTests-1585065700 None] Created volume successfully. Jul 21 19:20:01 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91" returned: 0 in 0.389s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:01 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 Jul 21 19:20:01 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:01 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717" returned: 0 in 0.333s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:01 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:01 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717 Jul 21 19:20:01 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:02 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91.cfc3d8c9-6f47-490e-a6a4-9c011fea8717" returned: 0 in 0.237s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-cfc3d8c9-6f47-490e-a6a4-9c011fea8717" released by "_delete_snapshot" :: held 1.525s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91" released by "delete_snapshot" :: held 1.550s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Created reservations ['1d9996ef-9aba-44f9-bf96-67acbbf1f809', 'cfc02d98-9298-43dd-8ddc-856e7499c0bc', '3f8d0b1f-ab8d-472f-8c97-a2d4c776f169', '1dd99501-34aa-490f-929e-c3da406a669c'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:02 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Delete snapshot completed successfully. Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-3ecef76b-dfea-43c0-b0f4-cdc8e84ec6da tempest-ProjectReaderTests-911164663 None] Lock "cinder-cfc3d8c9-6f47-490e-a6a4-9c011fea8717-delete_snapshot" released by "delete_snapshot" :: held 1.696s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] Creating offline snapshot 452b0028-0cdd-47fd-95fe-b0890c3b569e of volume f0500afb-663f-476c-9f97-a6afaaad81fc {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Lock "cinder-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed90d6a8-5e56-4d0b-968e-1a36c09525bd]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ef77ca-0af1-46ed-8cfc-d09b13da6949]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:02 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:02 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc Jul 21 19:20:02 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:02 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 Jul 21 19:20:02 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:03 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc" returned: 0 in 0.494s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:03 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e 1G Jul 21 19:20:03 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:03 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91" returned: 0 in 0.419s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:03 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91 Jul 21 19:20:03 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:03 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91" returned: 0 in 0.261s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91" released by "delete_volume" :: held 0.745s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Created reservations ['331a0ddf-75b4-49fe-be0c-dee0df49bda6', '8af01020-30b1-4816-8c7d-cfa3c25ef5e8', '5245629a-b747-4d39-8d9d-d5a8ddd68b4e', '5d1efc7c-ca4c-4d5e-baff-ae25aa32b7a6'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:03 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:20:03 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:03 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e 1G" returned: 0 in 0.516s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0500afb-663f-476c-9f97-a6afaaad81fc -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:03 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0500afb-663f-476c-9f97-a6afaaad81fc -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e Jul 21 19:20:03 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:03 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.255s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:03 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Deleted volume successfully. Jul 21 19:20:03 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f8f6ac65-0f72-48cc-a893-e27e350926f8 tempest-ProjectReaderTests-911164663 None] Lock "cinder-3c6be045-3fe7-47fa-a2b7-8dd55db8eb91-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:04 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0500afb-663f-476c-9f97-a6afaaad81fc -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e" returned: 0 in 0.330s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:04 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e is being set with open permissions: ugo+rw Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:04 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e Jul 21 19:20:04 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:04 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e" returned: 0 in 0.280s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Flow 'volume_create_manager' (3b0ec462-24de-4903-9434-223c2f0680cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09f9f4b-a8e0-45bd-a175-130626da2c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09f9f4b-a8e0-45bd-a175-130626da2c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-228103601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8aa9f80-10e6-48c1-84c8-d2df88d8200c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97f7701be0144328fcd9e74a3439495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:04Z,use_quota=True,user_id='93b6fc418e594de8a51459511ada5ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:04 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.info Jul 21 19:20:04 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaef0dc6-ff05-4242-b648-ecd5f70217d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaef0dc6-ff05-4242-b648-ecd5f70217d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a145e763-c6e7-437f-b37b-0e0121c81674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a145e763-c6e7-437f-b37b-0e0121c81674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8aa9f80-10e6-48c1-84c8-d2df88d8200c', 'volume_name': 'volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1794715-b49b-43df-87c4-033f22b79bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1794715-b49b-43df-87c4-033f22b79bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcf428b-96a1-438b-aaa2-a9e2ceca8e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:04 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Volume d8aa9f80-10e6-48c1-84c8-d2df88d8200c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c', 'volume_size': 1} Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:04 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.info" returned: 0 in 0.289s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:04 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.info is being set with open permissions: ugo+rw Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:04 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.info Jul 21 19:20:04 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:04 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.info" returned: 0 in 0.286s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:04 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.521s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-228103601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8aa9f80-10e6-48c1-84c8-d2df88d8200c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97f7701be0144328fcd9e74a3439495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:04Z,use_quota=True,user_id='93b6fc418e594de8a51459511ada5ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Creating volume d8aa9f80-10e6-48c1-84c8-d2df88d8200c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:05 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:05 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c 1073741824 Jul 21 19:20:05 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-1bc6d738-b8a0-4d71-a65b-bc6bbd8ca5f2 tempest-ProjectMemberTests-1585065700 None] Create snapshot completed successfully Jul 21 19:20:05 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c 1073741824" returned: 0 in 0.432s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:05 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c Jul 21 19:20:05 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:05 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c" returned: 0 in 0.283s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcf428b-96a1-438b-aaa2-a9e2ceca8e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78259ec3-8059-48d8-b50a-9771d2a8d889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:05 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Volume volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c (d8aa9f80-10e6-48c1-84c8-d2df88d8200c): created successfully Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78259ec3-8059-48d8-b50a-9771d2a8d889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Flow 'volume_create_manager' (3b0ec462-24de-4903-9434-223c2f0680cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:05 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-d76d98cc-05b2-4a21-a7fe-bc2935e4bdfb tempest-ProjectReaderTests-911164663 None] Created volume successfully. Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-452b0028-0cdd-47fd-95fe-b0890c3b569e-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-452b0028-0cdd-47fd-95fe-b0890c3b569e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-f0500afb-663f-476c-9f97-a6afaaad81fc" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-f0500afb-663f-476c-9f97-a6afaaad81fc" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-452b0028-0cdd-47fd-95fe-b0890c3b569e" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-452b0028-0cdd-47fd-95fe-b0890c3b569e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Deleting offline snapshot 452b0028-0cdd-47fd-95fe-b0890c3b569e of volume f0500afb-663f-476c-9f97-a6afaaad81fc {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:05 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] snapshot_file for this snap is: volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d2867d-06d6-4197-86e9-e45275b27c4a]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:06 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e Jul 21 19:20:06 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:06 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e" returned: 0 in 0.402s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0500afb-663f-476c-9f97-a6afaaad81fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1e256e-95d2-43ea-b825-114c7acedac9]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:06 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc Jul 21 19:20:06 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:06 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] Creating offline snapshot 2d44b3a3-5d18-408e-8587-aa20111d8145 of volume d8aa9f80-10e6-48c1-84c8-d2df88d8200c {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:06 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ab648b-19dc-44b7-afa9-08b3aedfe522]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:06 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c Jul 21 19:20:06 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:06 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc" returned: 0 in 0.420s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:06 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:06 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e Jul 21 19:20:06 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:07 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c" returned: 0 in 0.360s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:07 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 1G Jul 21 19:20:07 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:07 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e" returned: 0 in 0.386s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:07 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e Jul 21 19:20:07 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:07 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 1G" returned: 0 in 0.411s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:07 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:07 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 Jul 21 19:20:07 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc.452b0028-0cdd-47fd-95fe-b0890c3b569e" returned: 0 in 0.250s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-452b0028-0cdd-47fd-95fe-b0890c3b569e" released by "_delete_snapshot" :: held 1.570s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-f0500afb-663f-476c-9f97-a6afaaad81fc" released by "delete_snapshot" :: held 1.594s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:07 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Created reservations ['4869c438-4192-4b86-871a-b9cc491c1fcb', '4ce675d2-fea2-4ecd-9364-09a76d81b998', '6897b1ec-d6a5-46c4-943c-aa72e2e98326', '4c1c4b56-9be9-4d87-9b32-1342819506a0'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:07 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Delete snapshot completed successfully. Jul 21 19:20:07 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-c23c848f-044a-4f42-9256-1972f6b9183f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-452b0028-0cdd-47fd-95fe-b0890c3b569e-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:07 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145" returned: 0 in 0.323s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:07 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 is being set with open permissions: ugo+rw Jul 21 19:20:07 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:07 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 Jul 21 19:20:07 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:08 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145" returned: 0 in 0.247s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:08 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.info Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-f0500afb-663f-476c-9f97-a6afaaad81fc-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:08 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-f0500afb-663f-476c-9f97-a6afaaad81fc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-f0500afb-663f-476c-9f97-a6afaaad81fc" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-f0500afb-663f-476c-9f97-a6afaaad81fc" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[169f754e-9bdb-451e-8d26-6584c8e61f32]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:08 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc Jul 21 19:20:08 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:08 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.info" returned: 0 in 0.270s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:08 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.info is being set with open permissions: ugo+rw Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:08 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.info Jul 21 19:20:08 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:08 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:08 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc" returned: 0 in 0.384s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.info" returned: 0 in 0.282s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:08 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc Jul 21 19:20:08 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:08 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3626ee7b-1dbc-4de2-8926-5e632390f397 tempest-ProjectReaderTests-911164663 None] Create snapshot completed successfully Jul 21 19:20:08 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f0500afb-663f-476c-9f97-a6afaaad81fc" returned: 0 in 0.313s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:08 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-f0500afb-663f-476c-9f97-a6afaaad81fc" released by "delete_volume" :: held 0.759s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Created reservations ['0d0e52a3-ef66-48e7-86e6-1df60032675d', 'abab18d5-42aa-4a19-84c0-3ea736451e0e', 'cead9d48-bf70-498d-b4fc-01a4efadd215', '15df579c-a54a-4a15-83aa-f7695b4578f3'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:09 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:20:09 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:09 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.305s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:09 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Deleted volume successfully. Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-971a1843-07a9-40e1-bd8e-1c320a86aae2 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-f0500afb-663f-476c-9f97-a6afaaad81fc-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (663027e7-b243-4258-b881-a3a66189facb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ca0164-905b-4d76-aef8-295fdb9bb1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ca0164-905b-4d76-aef8-295fdb9bb1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549298141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6038c760-4947-492e-9085-16abbbe843d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:10Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3163293f-ca67-4cb2-9757-27eb68e22293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3163293f-ca67-4cb2-9757-27eb68e22293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e259f835-ecf7-4c91-9890-31d969f54246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e259f835-ecf7-4c91-9890-31d969f54246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6038c760-4947-492e-9085-16abbbe843d3', 'volume_name': 'volume-6038c760-4947-492e-9085-16abbbe843d3', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c9cbf3-cd07-4763-b167-c666e733539f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c9cbf3-cd07-4763-b167-c666e733539f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5b2d8d-dfb2-461a-956e-60f03e37387e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:09 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Volume 6038c760-4947-492e-9085-16abbbe843d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6038c760-4947-492e-9085-16abbbe843d3', 'volume_size': 1} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549298141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6038c760-4947-492e-9085-16abbbe843d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:10Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Creating volume 6038c760-4947-492e-9085-16abbbe843d3 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:09 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-2d44b3a3-5d18-408e-8587-aa20111d8145-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Lock "cinder-2d44b3a3-5d18-408e-8587-aa20111d8145-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-d8aa9f80-10e6-48c1-84c8-d2df88d8200c" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:09 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3 1073741824 Jul 21 19:20:09 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-d8aa9f80-10e6-48c1-84c8-d2df88d8200c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-2d44b3a3-5d18-408e-8587-aa20111d8145" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-2d44b3a3-5d18-408e-8587-aa20111d8145" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Deleting offline snapshot 2d44b3a3-5d18-408e-8587-aa20111d8145 of volume d8aa9f80-10e6-48c1-84c8-d2df88d8200c {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] snapshot_file for this snap is: volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[b854e1f6-d593-43ca-9467-8551466bb8bb]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:09 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:10 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 Jul 21 19:20:10 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:10 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145" returned: 0 in 0.407s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:10 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3 1073741824" returned: 0 in 0.542s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d45965-d795-4955-b9f6-51b5479fb084]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:10 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3 Jul 21 19:20:10 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:10 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c Jul 21 19:20:10 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:10 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3" returned: 0 in 0.326s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5b2d8d-dfb2-461a-956e-60f03e37387e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6038c760-4947-492e-9085-16abbbe843d3', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65f335d-538a-4920-898e-1037211a3955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:10 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Volume volume-6038c760-4947-492e-9085-16abbbe843d3 (6038c760-4947-492e-9085-16abbbe843d3): created successfully Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65f335d-538a-4920-898e-1037211a3955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (663027e7-b243-4258-b881-a3a66189facb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:10 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c" returned: 0 in 0.461s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:10 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:10 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-da303156-f9c8-4fd4-9d1f-44a1f1c9991d tempest-ProjectMemberTests-1585065700 None] Created volume successfully. Jul 21 19:20:10 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 Jul 21 19:20:10 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:11 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145" returned: 0 in 0.402s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:11 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145 Jul 21 19:20:11 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:11 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:11 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c.2d44b3a3-5d18-408e-8587-aa20111d8145" returned: 0 in 0.277s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-2d44b3a3-5d18-408e-8587-aa20111d8145" released by "_delete_snapshot" :: held 1.661s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-d8aa9f80-10e6-48c1-84c8-d2df88d8200c" released by "delete_snapshot" :: held 1.684s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:11 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Created reservations ['96b5590b-7984-4c74-919a-72dce8c2071d', 'a0598d29-39af-42c2-8609-53ba80d05bb4', 'c474825f-72d6-4cb5-a3fc-03baaa00479c', '461bb382-ca5e-4afe-ad3f-d4ae66068a91'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:11 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Delete snapshot completed successfully. Jul 21 19:20:11 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-f412f30c-7bff-4926-b842-66398c2ec5c1 tempest-ProjectReaderTests-911164663 None] Lock "cinder-2d44b3a3-5d18-408e-8587-aa20111d8145-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-d8aa9f80-10e6-48c1-84c8-d2df88d8200c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Lock "cinder-d8aa9f80-10e6-48c1-84c8-d2df88d8200c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-d8aa9f80-10e6-48c1-84c8-d2df88d8200c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-d8aa9f80-10e6-48c1-84c8-d2df88d8200c" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[5109536e-38e2-44a9-8740-714dee154a0a]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:12 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c Jul 21 19:20:12 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] Creating offline snapshot b445f9aa-5535-4b3e-bc8d-0112967c4911 of volume 6038c760-4947-492e-9085-16abbbe843d3 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f292141f-0df3-44f2-b5ef-c165f771c3f5]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:12 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3 Jul 21 19:20:12 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:12 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c" returned: 0 in 0.392s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:12 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c Jul 21 19:20:12 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:12 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3" returned: 0 in 0.363s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:12 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 1G Jul 21 19:20:12 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:12 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-d8aa9f80-10e6-48c1-84c8-d2df88d8200c" returned: 0 in 0.287s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-d8aa9f80-10e6-48c1-84c8-d2df88d8200c" released by "delete_volume" :: held 0.742s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Created reservations ['5f7bd179-c4c2-43d0-8b66-978a0ac4e21d', '09539be3-ff0b-48e3-ad23-3b1a8b2c7a87', 'c491eba8-3d2d-4533-868a-48bcf7cc49be', '60c8a67d-cf67-4740-9937-0b6e100660e4'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:12 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:13 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:20:13 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:13 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 1G" returned: 0 in 0.429s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6038c760-4947-492e-9085-16abbbe843d3 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:13 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6038c760-4947-492e-9085-16abbbe843d3 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 Jul 21 19:20:13 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:13 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.307s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:13 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Deleted volume successfully. Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-01ed152b-eb5a-490d-8fad-923d1e09dcfe tempest-ProjectReaderTests-911164663 None] Lock "cinder-d8aa9f80-10e6-48c1-84c8-d2df88d8200c-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:13 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6038c760-4947-492e-9085-16abbbe843d3 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911" returned: 0 in 0.344s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:13 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 is being set with open permissions: ugo+rw Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:13 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 Jul 21 19:20:13 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Flow 'volume_create_manager' (c2ae4b99-8ca5-455d-901b-f9dc5dccfa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22323335-72f2-4991-b487-e89f65d5483a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22323335-72f2-4991-b487-e89f65d5483a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961884454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73da07a5-23c3-4d8c-9efd-2642e22ef341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97f7701be0144328fcd9e74a3439495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:14Z,use_quota=True,user_id='93b6fc418e594de8a51459511ada5ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c34775c-f5f7-4ee0-aa04-e31116aaf5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c34775c-f5f7-4ee0-aa04-e31116aaf5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0689446-6e7a-458f-b438-0d36f838dd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0689446-6e7a-458f-b438-0d36f838dd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73da07a5-23c3-4d8c-9efd-2642e22ef341', 'volume_name': 'volume-73da07a5-23c3-4d8c-9efd-2642e22ef341', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:13 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33a84f4-17cd-4614-bd46-bee1fc8d2ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33a84f4-17cd-4614-bd46-bee1fc8d2ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae48dd1f-7bea-4e67-a3da-e70f8ac8e5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:13 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Volume 73da07a5-23c3-4d8c-9efd-2642e22ef341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73da07a5-23c3-4d8c-9efd-2642e22ef341', 'volume_size': 1} Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911" returned: 0 in 0.301s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:13 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:13 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.info Jul 21 19:20:13 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:14 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.info" returned: 0 in 0.247s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:14 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.info is being set with open permissions: ugo+rw Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:14 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.info Jul 21 19:20:14 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:14 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.info" returned: 0 in 0.292s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961884454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73da07a5-23c3-4d8c-9efd-2642e22ef341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97f7701be0144328fcd9e74a3439495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:14Z,use_quota=True,user_id='93b6fc418e594de8a51459511ada5ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Creating volume 73da07a5-23c3-4d8c-9efd-2642e22ef341 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:14 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:14 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 1073741824 Jul 21 19:20:14 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:14 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a155a21e-b68d-4567-8a62-f6b018396801 tempest-ProjectMemberTests-1585065700 None] Create snapshot completed successfully Jul 21 19:20:14 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 1073741824" returned: 0 in 0.412s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:14 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:14 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 Jul 21 19:20:14 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:15 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341" returned: 0 in 0.231s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae48dd1f-7bea-4e67-a3da-e70f8ac8e5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73da07a5-23c3-4d8c-9efd-2642e22ef341', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (970b3b65-d127-45a6-b617-91ccb3d82e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:15 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Volume volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 (73da07a5-23c3-4d8c-9efd-2642e22ef341): created successfully Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (970b3b65-d127-45a6-b617-91ccb3d82e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Flow 'volume_create_manager' (c2ae4b99-8ca5-455d-901b-f9dc5dccfa07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:15 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-c49c3e5b-6d4a-478d-9464-8de57a7bf6ad tempest-ProjectReaderTests-911164663 None] Created volume successfully. Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-b445f9aa-5535-4b3e-bc8d-0112967c4911-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-b445f9aa-5535-4b3e-bc8d-0112967c4911-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-6038c760-4947-492e-9085-16abbbe843d3" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-6038c760-4947-492e-9085-16abbbe843d3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-b445f9aa-5535-4b3e-bc8d-0112967c4911" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-b445f9aa-5535-4b3e-bc8d-0112967c4911" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Deleting offline snapshot b445f9aa-5535-4b3e-bc8d-0112967c4911 of volume 6038c760-4947-492e-9085-16abbbe843d3 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] snapshot_file for this snap is: volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd151ef6-4f1e-4575-a175-02e5d1720cf5]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:15 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 Jul 21 19:20:15 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] Creating offline snapshot d25e7619-0d8b-4f7b-a861-a4b0af476772 of volume 73da07a5-23c3-4d8c-9efd-2642e22ef341 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9bc27a-42a3-4730-b0e8-cdc820b17c5d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:15 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911" returned: 0 in 0.419s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:15 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6038c760-4947-492e-9085-16abbbe843d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:16 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[3befe7e0-0cf8-4af0-9ade-4c4cc6e3b3e0]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:16 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 Jul 21 19:20:16 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:16 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3 Jul 21 19:20:16 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:16 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341" returned: 0 in 0.374s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:16 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 1G Jul 21 19:20:16 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:16 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3" returned: 0 in 0.365s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:16 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 Jul 21 19:20:16 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:16 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911" returned: 0 in 0.335s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:16 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 1G" returned: 0 in 0.405s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:16 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911 Jul 21 19:20:16 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:16 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 Jul 21 19:20:16 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:16 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:16 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3.b445f9aa-5535-4b3e-bc8d-0112967c4911" returned: 0 in 0.263s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-b445f9aa-5535-4b3e-bc8d-0112967c4911" released by "_delete_snapshot" :: held 1.479s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-6038c760-4947-492e-9085-16abbbe843d3" released by "delete_snapshot" :: held 1.506s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:17 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772" returned: 0 in 0.313s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:17 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 is being set with open permissions: ugo+rw Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:17 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 Jul 21 19:20:17 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Created reservations ['1897aa31-aefd-4a85-a744-88e3705f7c67', '5a78fe7a-cebe-4539-8a83-8d13a0d3c622', '56c8d8a6-6ccf-476c-9573-5db6c2ec430d', '28b30096-2d1f-4bdb-87ad-6509816c9dad'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:17 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Delete snapshot completed successfully. Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9b93921b-1a11-4538-958a-5a16c79d91e0 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-b445f9aa-5535-4b3e-bc8d-0112967c4911-delete_snapshot" released by "delete_snapshot" :: held 1.675s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:17 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772" returned: 0 in 0.251s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:17 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.info Jul 21 19:20:17 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:17 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.info" returned: 0 in 0.234s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:17 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.info is being set with open permissions: ugo+rw Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:17 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.info Jul 21 19:20:17 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-6038c760-4947-492e-9085-16abbbe843d3-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-6038c760-4947-492e-9085-16abbbe843d3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-6038c760-4947-492e-9085-16abbbe843d3" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-6038c760-4947-492e-9085-16abbbe843d3" acquired by "delete_volume" :: waited 0.014s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f7004b-d414-4506-8722-c382cc3c029c]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:17 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.info" returned: 0 in 0.259s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:17 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:17 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3 Jul 21 19:20:17 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:17 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-072ea6c5-61da-41be-bec6-a8a16f35cc7a tempest-ProjectReaderTests-911164663 None] Create snapshot completed successfully Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-d25e7619-0d8b-4f7b-a861-a4b0af476772-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Lock "cinder-d25e7619-0d8b-4f7b-a861-a4b0af476772-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-73da07a5-23c3-4d8c-9efd-2642e22ef341" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-73da07a5-23c3-4d8c-9efd-2642e22ef341" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-d25e7619-0d8b-4f7b-a861-a4b0af476772" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-d25e7619-0d8b-4f7b-a861-a4b0af476772" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Deleting offline snapshot d25e7619-0d8b-4f7b-a861-a4b0af476772 of volume 73da07a5-23c3-4d8c-9efd-2642e22ef341 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:18 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] snapshot_file for this snap is: volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3" returned: 0 in 0.391s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10be905-02d8-4a45-954f-ac758367e553]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:18 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3 Jul 21 19:20:18 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:18 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 Jul 21 19:20:18 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:18 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-6038c760-4947-492e-9085-16abbbe843d3" returned: 0 in 0.246s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-6038c760-4947-492e-9085-16abbbe843d3" released by "delete_volume" :: held 0.698s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Created reservations ['e23864ed-ec5c-4a4d-9fad-47081d8e95dc', '025f7e4e-e4ae-4dfd-a164-68f2d50d069d', 'd0e53317-a793-4bba-8948-9a5dc6fccba3', 'b1ccf1de-2b78-4517-9e86-41e132e090bd'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:18 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772" returned: 0 in 0.369s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73da07a5-23c3-4d8c-9efd-2642e22ef341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8537e247-0d83-4a18-b0cb-71fb0bc5522d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:18 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:20:18 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:18 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 Jul 21 19:20:18 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:18 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.262s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:18 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Deleted volume successfully. Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-7d72e7af-442b-4ee7-a75e-7b14e8015b39 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-6038c760-4947-492e-9085-16abbbe843d3-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:18 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341" returned: 0 in 0.378s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:18 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:18 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 Jul 21 19:20:18 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (1f4db064-d28e-435a-868d-43d275e66a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:19 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecf598d-36bb-43d4-9f9d-1f9eb00538d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772" returned: 0 in 0.376s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:19 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772 Jul 21 19:20:19 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecf598d-36bb-43d4-9f9d-1f9eb00538d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1957196562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4239a743-0688-45e9-96eb-f184aa93c8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:19Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0e351d-b922-4ffb-955f-995a70af3d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0e351d-b922-4ffb-955f-995a70af3d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03768f24-0faf-424f-88d2-f349f4809705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03768f24-0faf-424f-88d2-f349f4809705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4239a743-0688-45e9-96eb-f184aa93c8fb', 'volume_name': 'volume-4239a743-0688-45e9-96eb-f184aa93c8fb', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802e3bb9-e49b-458f-a63c-e7dd251b6037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802e3bb9-e49b-458f-a63c-e7dd251b6037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c1099a-c35b-476d-a88d-e02db1f0b7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:19 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Volume 4239a743-0688-45e9-96eb-f184aa93c8fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4239a743-0688-45e9-96eb-f184aa93c8fb', 'volume_size': 1} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1957196562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4239a743-0688-45e9-96eb-f184aa93c8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:19Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Creating volume 4239a743-0688-45e9-96eb-f184aa93c8fb {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:19 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:19 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb 1073741824 Jul 21 19:20:19 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:19 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341.d25e7619-0d8b-4f7b-a861-a4b0af476772" returned: 0 in 0.259s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-d25e7619-0d8b-4f7b-a861-a4b0af476772" released by "_delete_snapshot" :: held 1.493s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-73da07a5-23c3-4d8c-9efd-2642e22ef341" released by "delete_snapshot" :: held 1.514s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Created reservations ['f1a26f50-7d58-4d25-b9de-437c006c9a1b', 'f2b38dc1-47dc-457d-9a28-cf027070cd19', '83e2895a-0077-4e90-b0d4-bef680156ce9', '786fa36b-c31f-48f1-8d8a-26c7aca5b967'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:19 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Delete snapshot completed successfully. Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-2a30cf1a-c5d7-478b-87a7-457667fa4cc6 tempest-ProjectReaderTests-911164663 None] Lock "cinder-d25e7619-0d8b-4f7b-a861-a4b0af476772-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:19 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb 1073741824" returned: 0 in 0.488s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:19 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:19 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb Jul 21 19:20:19 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:20 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb" returned: 0 in 0.233s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c1099a-c35b-476d-a88d-e02db1f0b7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4239a743-0688-45e9-96eb-f184aa93c8fb', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a2e848-858a-4984-b3f7-7998f6b71c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:20 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Volume volume-4239a743-0688-45e9-96eb-f184aa93c8fb (4239a743-0688-45e9-96eb-f184aa93c8fb): created successfully Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a2e848-858a-4984-b3f7-7998f6b71c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (1f4db064-d28e-435a-868d-43d275e66a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:20 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-0b9ff53f-77d5-4c8f-919a-1f653fd3c6f5 tempest-ProjectMemberTests-1585065700 None] Created volume successfully. Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-73da07a5-23c3-4d8c-9efd-2642e22ef341-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Lock "cinder-73da07a5-23c3-4d8c-9efd-2642e22ef341-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-73da07a5-23c3-4d8c-9efd-2642e22ef341" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-73da07a5-23c3-4d8c-9efd-2642e22ef341" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf9f661-4527-4429-bc27-5d9018eb093e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:20 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 Jul 21 19:20:20 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] Creating offline snapshot 1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 of volume 4239a743-0688-45e9-96eb-f184aa93c8fb {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1367640d-9d28-454f-8d7b-95b4dc87703e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:20 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb Jul 21 19:20:20 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:20 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341" returned: 0 in 0.364s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:20 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341 Jul 21 19:20:20 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:20 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb" returned: 0 in 0.388s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:20 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 1G Jul 21 19:20:20 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:20 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-73da07a5-23c3-4d8c-9efd-2642e22ef341" returned: 0 in 0.244s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:20 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-73da07a5-23c3-4d8c-9efd-2642e22ef341" released by "delete_volume" :: held 0.670s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Created reservations ['a6fce1da-681c-420b-aff0-36e5cb80e2e9', '8c6f9b80-197c-4382-9fbf-ba21e8d7e584', '46417d49-3534-4c5d-8719-bf0d450c48b3', '5a616a9b-1e6e-4504-9092-bbd136eb21da'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:21 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:20:21 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:21 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 1G" returned: 0 in 0.380s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4239a743-0688-45e9-96eb-f184aa93c8fb -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:21 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4239a743-0688-45e9-96eb-f184aa93c8fb -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 Jul 21 19:20:21 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:21 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.262s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:21 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Deleted volume successfully. Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-22dbac14-5130-4ecf-bd35-bad774641a02 tempest-ProjectReaderTests-911164663 None] Lock "cinder-73da07a5-23c3-4d8c-9efd-2642e22ef341-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:21 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4239a743-0688-45e9-96eb-f184aa93c8fb -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3" returned: 0 in 0.310s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:21 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 is being set with open permissions: ugo+rw Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:21 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 Jul 21 19:20:21 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:21 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3" returned: 0 in 0.254s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:21 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.info Jul 21 19:20:21 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Flow 'volume_create_manager' (1d3defaf-9e7e-4d42-bf75-d14b628427bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193ef07f-8657-4298-a426-2b939f9c60e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193ef07f-8657-4298-a426-2b939f9c60e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1059590772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f771e1a-5b8d-46dd-8789-696d4b11c2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97f7701be0144328fcd9e74a3439495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:22Z,use_quota=True,user_id='93b6fc418e594de8a51459511ada5ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db367ab-e2bf-4232-a5c8-be69dd854e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db367ab-e2bf-4232-a5c8-be69dd854e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b72ed7-f47e-4351-ad9f-7e8c768feb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b72ed7-f47e-4351-ad9f-7e8c768feb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f771e1a-5b8d-46dd-8789-696d4b11c2ec', 'volume_name': 'volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86720fd-1381-42c0-a61b-7732f8b2f09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86720fd-1381-42c0-a61b-7732f8b2f09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4df8b8-b68e-43c3-813a-3b3c825153ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:21 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Volume 0f771e1a-5b8d-46dd-8789-696d4b11c2ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec', 'volume_size': 1} Jul 21 19:20:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:22 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.info" returned: 0 in 0.239s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:22 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.info is being set with open permissions: ugo+rw Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:22 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.info Jul 21 19:20:22 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:22 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.info" returned: 0 in 0.235s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.399s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1059590772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f771e1a-5b8d-46dd-8789-696d4b11c2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97f7701be0144328fcd9e74a3439495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:22Z,use_quota=True,user_id='93b6fc418e594de8a51459511ada5ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Creating volume 0f771e1a-5b8d-46dd-8789-696d4b11c2ec {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:22 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:22 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec 1073741824 Jul 21 19:20:22 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:22 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-cd16435f-cebc-4535-8574-ff1989117fef tempest-ProjectMemberTests-1585065700 None] Create snapshot completed successfully Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-4239a743-0688-45e9-96eb-f184aa93c8fb" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-4239a743-0688-45e9-96eb-f184aa93c8fb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Deleting offline snapshot 1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 of volume 4239a743-0688-45e9-96eb-f184aa93c8fb {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] snapshot_file for this snap is: volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e064a5b2-ff10-49d4-9af0-21c3b417cb2e]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:22 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 Jul 21 19:20:22 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:22 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec 1073741824" returned: 0 in 0.459s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:22 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec Jul 21 19:20:22 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:23 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3" returned: 0 in 0.386s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4239a743-0688-45e9-96eb-f184aa93c8fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e79d9e-8a7a-46f6-aff7-35c45194a9ca]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:23 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec" returned: 0 in 0.258s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4df8b8-b68e-43c3-813a-3b3c825153ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8243610f-eee9-476e-8e1a-e007f4e14d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:23 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Volume volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec (0f771e1a-5b8d-46dd-8789-696d4b11c2ec): created successfully Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8243610f-eee9-476e-8e1a-e007f4e14d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Flow 'volume_create_manager' (1d3defaf-9e7e-4d42-bf75-d14b628427bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:23 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-474cc2b0-bdd8-4235-9ecd-7c55c879c4b7 tempest-ProjectReaderTests-911164663 None] Created volume successfully. Jul 21 19:20:23 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb Jul 21 19:20:23 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:23 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb" returned: 0 in 0.339s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:23 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 Jul 21 19:20:23 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:23 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3" returned: 0 in 0.324s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:23 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3 Jul 21 19:20:23 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:23 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb.1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3" returned: 0 in 0.245s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3" released by "_delete_snapshot" :: held 1.392s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-4239a743-0688-45e9-96eb-f184aa93c8fb" released by "delete_snapshot" :: held 1.414s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] Creating offline snapshot dbbf5b79-1dfd-4f90-a9c3-affe1ff232da of volume 0f771e1a-5b8d-46dd-8789-696d4b11c2ec {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Created reservations ['6fef99f3-15d0-4e2a-9b52-18e43e366760', '503f082c-59ca-4768-a1f5-b8e775f49932', '5d7d26f6-bde0-4d41-8831-c1148c393174', 'b33d71d5-9f04-4bae-91ac-f2199f47fe13'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b11d808-56b6-45e8-9f9a-8416f774c636]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:24 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Delete snapshot completed successfully. Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-9f2fd8fe-2a4c-43ad-8166-89d070b3883f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-1a5a866e-6ebc-4a63-9123-fbd2d14dd2b3-delete_snapshot" released by "delete_snapshot" :: held 1.596s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:24 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec Jul 21 19:20:24 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:24 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec" returned: 0 in 0.349s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:24 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da 1G Jul 21 19:20:24 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-4239a743-0688-45e9-96eb-f184aa93c8fb-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Lock "cinder-4239a743-0688-45e9-96eb-f184aa93c8fb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-4239a743-0688-45e9-96eb-f184aa93c8fb" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-4239a743-0688-45e9-96eb-f184aa93c8fb" acquired by "delete_volume" :: waited 0.013s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f3437f-e946-4a27-ae7d-a0c409dbd8ab]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:24 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da 1G" returned: 0 in 0.437s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:24 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da Jul 21 19:20:24 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:24 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb Jul 21 19:20:24 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:25 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da" returned: 0 in 0.279s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:25 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da is being set with open permissions: ugo+rw Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:25 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da Jul 21 19:20:25 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:25 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb" returned: 0 in 0.375s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:25 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb Jul 21 19:20:25 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:25 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da" returned: 0 in 0.235s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:25 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-4239a743-0688-45e9-96eb-f184aa93c8fb" returned: 0 in 0.247s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:25 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.info Jul 21 19:20:25 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-4239a743-0688-45e9-96eb-f184aa93c8fb" released by "delete_volume" :: held 0.687s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Created reservations ['7583bbce-91ea-4c20-8143-736c32a226b1', 'e5c07915-b0a5-4295-8edd-0382fe888501', '229d30d7-b1da-4022-ab21-f3f0b87bcd85', '0618fae3-7b05-4de2-a161-c091355bf8cb'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:25 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:20:25 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:25 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.info" returned: 0 in 0.265s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:25 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.info is being set with open permissions: ugo+rw Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:25 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.info Jul 21 19:20:25 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:25 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.261s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:25 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Deleted volume successfully. Jul 21 19:20:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-cb2baf71-cd1a-4e87-be31-a9e1e09ff2dc tempest-ProjectMemberTests-1585065700 None] Lock "cinder-4239a743-0688-45e9-96eb-f184aa93c8fb-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:25 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.info" returned: 0 in 0.260s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:26 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-ccb09f50-d00b-4bf4-bfa0-b83273ef465e tempest-ProjectReaderTests-911164663 None] Create snapshot completed successfully Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-dbbf5b79-1dfd-4f90-a9c3-affe1ff232da-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Lock "cinder-dbbf5b79-1dfd-4f90-a9c3-affe1ff232da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-0f771e1a-5b8d-46dd-8789-696d4b11c2ec" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-0f771e1a-5b8d-46dd-8789-696d4b11c2ec" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-dbbf5b79-1dfd-4f90-a9c3-affe1ff232da" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-dbbf5b79-1dfd-4f90-a9c3-affe1ff232da" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Deleting offline snapshot dbbf5b79-1dfd-4f90-a9c3-affe1ff232da of volume 0f771e1a-5b8d-46dd-8789-696d4b11c2ec {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] snapshot_file for this snap is: volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a616cb75-cc3c-40a6-9cde-fa596c181b80]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (f2241e44-3696-414b-a56d-bf1f994c4b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f3414b-5b79-4d8e-ae50-a0a75949333f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f3414b-5b79-4d8e-ae50-a0a75949333f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584356676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5f25fc-f08c-4999-be84-154169f77780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:26Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5004a65-a0bd-4148-9658-2d3e61d41b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5004a65-a0bd-4148-9658-2d3e61d41b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:26 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da Jul 21 19:20:26 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8694fbab-7c83-4e79-8801-2bdb4cc8e17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8694fbab-7c83-4e79-8801-2bdb4cc8e17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5f25fc-f08c-4999-be84-154169f77780', 'volume_name': 'volume-3a5f25fc-f08c-4999-be84-154169f77780', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c30b31-2d7a-4f9d-9b62-0daf9cecd32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c30b31-2d7a-4f9d-9b62-0daf9cecd32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0871f28c-b00a-4cb7-a6b7-51826e3ab9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:26 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Volume 3a5f25fc-f08c-4999-be84-154169f77780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5f25fc-f08c-4999-be84-154169f77780', 'volume_size': 1} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584356676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5f25fc-f08c-4999-be84-154169f77780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:26Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Creating volume 3a5f25fc-f08c-4999-be84-154169f77780 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:26 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:26 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780 1073741824 Jul 21 19:20:26 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:26 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da" returned: 0 in 0.366s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e304be2-b0ae-4ee1-a422-8ad81cec3506]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:26 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec Jul 21 19:20:26 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:26 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780 1073741824" returned: 0 in 0.425s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:26 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:26 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780 Jul 21 19:20:26 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:27 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec" returned: 0 in 0.373s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:27 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da Jul 21 19:20:27 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:27 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780" returned: 0 in 0.249s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0871f28c-b00a-4cb7-a6b7-51826e3ab9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5f25fc-f08c-4999-be84-154169f77780', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a80b573-2e87-4e06-9e79-b36a753cb3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:27 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Volume volume-3a5f25fc-f08c-4999-be84-154169f77780 (3a5f25fc-f08c-4999-be84-154169f77780): created successfully Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a80b573-2e87-4e06-9e79-b36a753cb3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (f2241e44-3696-414b-a56d-bf1f994c4b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:27 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-95c95600-3014-4f71-af7b-ced3dd733ba0 tempest-ProjectMemberTests-1585065700 None] Created volume successfully. Jul 21 19:20:27 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da" returned: 0 in 0.316s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:27 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da Jul 21 19:20:27 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] Creating offline snapshot 6a33db75-f3fd-407f-a5c4-36d1eae728a2 of volume 3a5f25fc-f08c-4999-be84-154169f77780 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dff219-bb0a-4ff1-b127-88afb2e7032a]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:27 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780 Jul 21 19:20:27 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:27 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec.dbbf5b79-1dfd-4f90-a9c3-affe1ff232da" returned: 0 in 0.274s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-dbbf5b79-1dfd-4f90-a9c3-affe1ff232da" released by "_delete_snapshot" :: held 1.429s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-0f771e1a-5b8d-46dd-8789-696d4b11c2ec" released by "delete_snapshot" :: held 1.460s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Created reservations ['aef56367-74f7-4923-964c-bd7d626b9e83', 'b79f9cb6-177c-4161-aa54-64a7b88affa3', '717b0d07-5a4a-4638-b957-dad9731cefbb', 'bab674e5-29bc-45c2-9321-a365bafb3c1f'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:27 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Delete snapshot completed successfully. Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-db45c4e5-094c-43ec-9e88-8aa1b1594a73 tempest-ProjectReaderTests-911164663 None] Lock "cinder-dbbf5b79-1dfd-4f90-a9c3-affe1ff232da-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:27 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780" returned: 0 in 0.381s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:27 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:27 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 1G Jul 21 19:20:27 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:28 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 1G" returned: 0 in 0.366s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a5f25fc-f08c-4999-be84-154169f77780 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:28 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a5f25fc-f08c-4999-be84-154169f77780 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 Jul 21 19:20:28 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-0f771e1a-5b8d-46dd-8789-696d4b11c2ec-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Lock "cinder-0f771e1a-5b8d-46dd-8789-696d4b11c2ec-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Acquiring lock "cinder-quobyte-0f771e1a-5b8d-46dd-8789-696d4b11c2ec" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:28 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-0f771e1a-5b8d-46dd-8789-696d4b11c2ec" acquired by "delete_volume" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:28 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d8058b-9ce9-4685-9f70-6d132dff06cf]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:28 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a5f25fc-f08c-4999-be84-154169f77780 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2" returned: 0 in 0.297s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:28 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 is being set with open permissions: ugo+rw Jul 21 19:20:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:28 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 Jul 21 19:20:28 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:28 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec Jul 21 19:20:28 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:28 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2" returned: 0 in 0.248s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:28 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.info Jul 21 19:20:28 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:28 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec" returned: 0 in 0.382s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:28 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:28 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec Jul 21 19:20:28 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:29 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.info" returned: 0 in 0.252s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:29 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.info is being set with open permissions: ugo+rw Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:29 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.info Jul 21 19:20:29 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:29 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0f771e1a-5b8d-46dd-8789-696d4b11c2ec" returned: 0 in 0.266s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Lock "cinder-quobyte-0f771e1a-5b8d-46dd-8789-696d4b11c2ec" released by "delete_volume" :: held 0.728s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Created reservations ['2684f39b-f9ba-4ff4-9a1e-a7f77518704d', '920f6eb0-61b9-4839-9532-68393f3fcd3e', '79ba0d4c-184b-4766-9710-ad8979b71d26', 'b15588ea-72c8-4c47-aad1-3b5c2bafa8b0'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:29 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:20:29 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:29 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.info" returned: 0 in 0.278s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:29 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-312c864b-2417-4250-94c8-9d2e0f84061f tempest-ProjectMemberTests-1585065700 None] Create snapshot completed successfully Jul 21 19:20:29 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.274s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:29 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Deleted volume successfully. Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-5e5b9d74-3c47-409f-adf9-de8baf52f783 tempest-ProjectReaderTests-911164663 None] Lock "cinder-0f771e1a-5b8d-46dd-8789-696d4b11c2ec-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-6a33db75-f3fd-407f-a5c4-36d1eae728a2-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-6a33db75-f3fd-407f-a5c4-36d1eae728a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-3a5f25fc-f08c-4999-be84-154169f77780" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-3a5f25fc-f08c-4999-be84-154169f77780" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-6a33db75-f3fd-407f-a5c4-36d1eae728a2" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-6a33db75-f3fd-407f-a5c4-36d1eae728a2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Deleting offline snapshot 6a33db75-f3fd-407f-a5c4-36d1eae728a2 of volume 3a5f25fc-f08c-4999-be84-154169f77780 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] snapshot_file for this snap is: volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1fe3a4-3d8c-4673-8544-ce8fe89b9e6f]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:29 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 Jul 21 19:20:29 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:30 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2" returned: 0 in 0.375s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:30 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a5f25fc-f08c-4999-be84-154169f77780(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:30 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7d95e6-f885-4c78-9a5d-916427790a2f]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:30 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780 Jul 21 19:20:30 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:30 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780" returned: 0 in 0.379s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:30 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 Jul 21 19:20:30 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:30 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2" returned: 0 in 0.423s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:31 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2 Jul 21 19:20:31 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:31 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780.6a33db75-f3fd-407f-a5c4-36d1eae728a2" returned: 0 in 0.297s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-6a33db75-f3fd-407f-a5c4-36d1eae728a2" released by "_delete_snapshot" :: held 1.576s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-3a5f25fc-f08c-4999-be84-154169f77780" released by "delete_snapshot" :: held 1.603s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:31 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Created reservations ['4fc520d4-c912-4a9c-bcf8-8747284f67fc', 'ce9bfda7-559e-48a9-8fd0-b109f7c09217', '337442af-2391-4e29-9232-94fc75aacf3a', '5ce119f3-5354-4cdc-9446-6faad1f311aa'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:31 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Delete snapshot completed successfully. Jul 21 19:20:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6fab9c98-f6a7-45d8-9305-2b79d076b7d6 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-6a33db75-f3fd-407f-a5c4-36d1eae728a2-delete_snapshot" released by "delete_snapshot" :: held 1.768s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-3a5f25fc-f08c-4999-be84-154169f77780-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Lock "cinder-3a5f25fc-f08c-4999-be84-154169f77780-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-3a5f25fc-f08c-4999-be84-154169f77780" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-3a5f25fc-f08c-4999-be84-154169f77780" acquired by "delete_volume" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:31 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85213ec-745b-4a4d-ac88-19fda03b9ef2]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:32 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780 Jul 21 19:20:32 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:32 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780" returned: 0 in 0.419s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:32 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780 Jul 21 19:20:32 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:32 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-3a5f25fc-f08c-4999-be84-154169f77780" returned: 0 in 0.280s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-3a5f25fc-f08c-4999-be84-154169f77780" released by "delete_volume" :: held 0.768s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:32 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Created reservations ['62284dcb-e216-4c78-96a6-2364843a1c8c', '43c112ba-7e4f-4dd0-bb78-15e797840adc', '227b7303-add9-4d40-ad3d-62fbfba0e210', '6264bdb3-0c5c-4f27-8f85-4f7049d7466f'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:32 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:32 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:20:32 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:33 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.295s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:33 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Deleted volume successfully. Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-eeb512df-44c8-4881-877e-37ca8322a95c tempest-ProjectMemberTests-1585065700 None] Lock "cinder-3a5f25fc-f08c-4999-be84-154169f77780-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (3c3283b5-ccdb-4ef8-9a9f-86434fd079ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e794ad2b-961f-43e2-a0ff-b3f57e9bb633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e794ad2b-961f-43e2-a0ff-b3f57e9bb633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1718806908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6cc5d2-7691-4903-bd3a-0be92cd6053c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:34Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61dd992-0bfd-4ed2-b7f1-15b7a3af8e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61dd992-0bfd-4ed2-b7f1-15b7a3af8e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b5f32e-a6fa-4b57-9fc7-ddc50f4182e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b5f32e-a6fa-4b57-9fc7-ddc50f4182e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6cc5d2-7691-4903-bd3a-0be92cd6053c', 'volume_name': 'volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e756cb-b16e-4e9e-b7ee-647febc181d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e756cb-b16e-4e9e-b7ee-647febc181d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e95704a-b43a-4e2e-bf4d-326af0ae73c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:33 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Volume 0a6cc5d2-7691-4903-bd3a-0be92cd6053c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c', 'volume_size': 1} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1718806908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6cc5d2-7691-4903-bd3a-0be92cd6053c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:34Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Creating volume 0a6cc5d2-7691-4903-bd3a-0be92cd6053c {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:33 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:20:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:33 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c 1073741824 Jul 21 19:20:33 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:34 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c 1073741824" returned: 0 in 0.406s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:34 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c Jul 21 19:20:34 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:34 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c" returned: 0 in 0.231s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e95704a-b43a-4e2e-bf4d-326af0ae73c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11cca88-bd52-4b32-ba3d-841af6d0cc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:34 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Volume volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c (0a6cc5d2-7691-4903-bd3a-0be92cd6053c): created successfully Jul 21 19:20:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11cca88-bd52-4b32-ba3d-841af6d0cc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:34 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (3c3283b5-ccdb-4ef8-9a9f-86434fd079ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:34 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a2284f21-16e4-4cc7-9f78-0cdd887fe3ff tempest-ProjectMemberTests-1585065700 None] Created volume successfully. Jul 21 19:20:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] Creating offline snapshot 797dd341-5be5-4afc-9c57-273be21303a7 of volume 0a6cc5d2-7691-4903-bd3a-0be92cd6053c {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:35 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[883abaa0-a7d1-42d1-9d41-96a8e93d94c4]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:35 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c Jul 21 19:20:35 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:36 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c" returned: 0 in 0.353s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:36 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 1G Jul 21 19:20:36 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:36 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 1G" returned: 0 in 0.396s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:36 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 Jul 21 19:20:36 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:36 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7" returned: 0 in 0.338s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:36 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 is being set with open permissions: ugo+rw Jul 21 19:20:36 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:36 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 Jul 21 19:20:36 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:37 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7" returned: 0 in 0.257s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:37 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.info Jul 21 19:20:37 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:37 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.info" returned: 0 in 0.284s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:37 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.info is being set with open permissions: ugo+rw Jul 21 19:20:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:37 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.info Jul 21 19:20:37 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:37 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.info" returned: 0 in 0.242s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:37 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:37 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3edbe94f-d2f6-4471-8555-fa95d9903026 tempest-ProjectMemberTests-1585065700 None] Create snapshot completed successfully Jul 21 19:20:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-797dd341-5be5-4afc-9c57-273be21303a7-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-797dd341-5be5-4afc-9c57-273be21303a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-0a6cc5d2-7691-4903-bd3a-0be92cd6053c" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-0a6cc5d2-7691-4903-bd3a-0be92cd6053c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:37 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-797dd341-5be5-4afc-9c57-273be21303a7" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:38 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-797dd341-5be5-4afc-9c57-273be21303a7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Deleting offline snapshot 797dd341-5be5-4afc-9c57-273be21303a7 of volume 0a6cc5d2-7691-4903-bd3a-0be92cd6053c {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] snapshot_file for this snap is: volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:38 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a85b380-6eef-439b-bec8-911678120a51]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:38 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 Jul 21 19:20:38 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:38 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7" returned: 0 in 0.361s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:38 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:38 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4e3991-6e73-4a78-857a-7863f7a40208]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:38 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c Jul 21 19:20:38 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:38 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c" returned: 0 in 0.410s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:38 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:38 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 Jul 21 19:20:38 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:39 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7" returned: 0 in 0.361s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:39 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7 Jul 21 19:20:39 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:39 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:39 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c.797dd341-5be5-4afc-9c57-273be21303a7" returned: 0 in 0.276s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-797dd341-5be5-4afc-9c57-273be21303a7" released by "_delete_snapshot" :: held 1.516s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-0a6cc5d2-7691-4903-bd3a-0be92cd6053c" released by "delete_snapshot" :: held 1.539s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:39 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Created reservations ['92d65c7a-19fc-4b1e-b271-64c5623e44a0', 'b32c7f1e-0d41-40b1-89af-94c9ce047a95', '025b28e5-4b01-4423-a25d-1af083bcdab9', 'efac2a5d-bf99-4f76-9471-90b25c37cda4'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:39 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Delete snapshot completed successfully. Jul 21 19:20:39 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-36c20931-84fc-4587-9ce5-abdaa2a0f67f tempest-ProjectMemberTests-1585065700 None] Lock "cinder-797dd341-5be5-4afc-9c57-273be21303a7-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-0a6cc5d2-7691-4903-bd3a-0be92cd6053c-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-0a6cc5d2-7691-4903-bd3a-0be92cd6053c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-0a6cc5d2-7691-4903-bd3a-0be92cd6053c" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-0a6cc5d2-7691-4903-bd3a-0be92cd6053c" acquired by "delete_volume" :: waited 0.023s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[52092046-695a-40d0-a9b4-871823c3f4c2]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:40 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c Jul 21 19:20:40 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:40 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c" returned: 0 in 0.406s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:40 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:20:40 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:40 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c Jul 21 19:20:40 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:40 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.276s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:20:40 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-0a6cc5d2-7691-4903-bd3a-0be92cd6053c" returned: 0 in 0.295s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-0a6cc5d2-7691-4903-bd3a-0be92cd6053c" released by "delete_volume" :: held 0.782s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Created reservations ['fb6eb058-1bc7-47d0-8694-800aa1bd63da', '61fdec93-690e-4a35-ae1b-9dc75c3fce3a', '4943dddd-c368-48e7-b140-c7569a5012c0', 'cb08db96-332b-4b38-b2c7-211697c027e7'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:41 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:20:41 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:41 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.271s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:41 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Deleted volume successfully. Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-99ea17af-db5f-45eb-9c4b-5837dd93ad44 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-0a6cc5d2-7691-4903-bd3a-0be92cd6053c-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (b0c1e66a-100f-48c4-b5b8-0b07de0734a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214b3892-f6a9-4cca-9bbd-b1ac19e7ba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214b3892-f6a9-4cca-9bbd-b1ac19e7ba14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1754168161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871bc4a9-95a8-4649-9554-da4aaef997ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:42Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d006d771-1de8-4a22-9809-faabe5233a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d006d771-1de8-4a22-9809-faabe5233a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1bafb5-2531-4705-bf6b-a84b9c722425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1bafb5-2531-4705-bf6b-a84b9c722425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '871bc4a9-95a8-4649-9554-da4aaef997ad', 'volume_name': 'volume-871bc4a9-95a8-4649-9554-da4aaef997ad', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd9f523-1f9b-431c-9b17-955ef53245df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd9f523-1f9b-431c-9b17-955ef53245df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b2c093-3e96-4719-a862-791f7ca77967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:41 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Volume 871bc4a9-95a8-4649-9554-da4aaef997ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-871bc4a9-95a8-4649-9554-da4aaef997ad', 'volume_size': 1} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1754168161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871bc4a9-95a8-4649-9554-da4aaef997ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d41ad3cc49459d9cf0fc86e861cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:42Z,use_quota=True,user_id='b1040a78fcc041deb596c1cbf339aa62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Creating volume 871bc4a9-95a8-4649-9554-da4aaef997ad {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:41 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:20:41 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:41 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad 1073741824 Jul 21 19:20:41 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:42 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad 1073741824" returned: 0 in 0.465s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:42 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad Jul 21 19:20:42 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:42 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad" returned: 0 in 0.250s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:42 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:42 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b2c093-3e96-4719-a862-791f7ca77967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871bc4a9-95a8-4649-9554-da4aaef997ad', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e735d67a-c2dd-4896-a1a6-1151d348ea72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:42 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Volume volume-871bc4a9-95a8-4649-9554-da4aaef997ad (871bc4a9-95a8-4649-9554-da4aaef997ad): created successfully Jul 21 19:20:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e735d67a-c2dd-4896-a1a6-1151d348ea72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:42 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Flow 'volume_create_manager' (b0c1e66a-100f-48c4-b5b8-0b07de0734a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:42 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-036c0e38-5f56-4b1e-a52b-9dc48e637d2d tempest-ProjectMemberTests-1585065700 None] Created volume successfully. Jul 21 19:20:44 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=216,cinder:DELETE=23,cinder:INSERT=79,cinder:UPDATE=305 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:20:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:44 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] Creating offline snapshot b78dab6a-44b4-4775-8825-c7b4b3862ae5 of volume 871bc4a9-95a8-4649-9554-da4aaef997ad {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:44 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[685f1362-ea30-46ce-90c9-15f3cafd9794]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:44 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad Jul 21 19:20:44 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:44 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad" returned: 0 in 0.361s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:44 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 1G Jul 21 19:20:44 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:44 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 1G" returned: 0 in 0.444s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:44 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-871bc4a9-95a8-4649-9554-da4aaef997ad -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:44 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-871bc4a9-95a8-4649-9554-da4aaef997ad -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 Jul 21 19:20:44 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:45 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-871bc4a9-95a8-4649-9554-da4aaef997ad -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5" returned: 0 in 0.323s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:45 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 is being set with open permissions: ugo+rw Jul 21 19:20:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:45 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 Jul 21 19:20:45 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:45 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5" returned: 0 in 0.245s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:45 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.info Jul 21 19:20:45 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:45 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.info" returned: 0 in 0.304s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:45 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.info is being set with open permissions: ugo+rw Jul 21 19:20:45 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:45 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.info Jul 21 19:20:45 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:46 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.info" returned: 0 in 0.242s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:46 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:46 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-4b4c2362-09a9-4bd5-910f-fb365210f7cf tempest-ProjectMemberTests-1585065700 None] Create snapshot completed successfully Jul 21 19:20:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-b78dab6a-44b4-4775-8825-c7b4b3862ae5-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-b78dab6a-44b4-4775-8825-c7b4b3862ae5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-871bc4a9-95a8-4649-9554-da4aaef997ad" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-871bc4a9-95a8-4649-9554-da4aaef997ad" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-b78dab6a-44b4-4775-8825-c7b4b3862ae5" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:47 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-b78dab6a-44b4-4775-8825-c7b4b3862ae5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Deleting offline snapshot b78dab6a-44b4-4775-8825-c7b4b3862ae5 of volume 871bc4a9-95a8-4649-9554-da4aaef997ad {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] snapshot_file for this snap is: volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:47 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa67eac5-ab3f-4ef8-8265-852b2b1baac9]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:47 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 Jul 21 19:20:47 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:47 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5" returned: 0 in 0.379s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:47 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-871bc4a9-95a8-4649-9554-da4aaef997ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:47 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[268fd204-e145-4008-869e-9bd092cbbdb5]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:47 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:47 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad Jul 21 19:20:47 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:48 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad" returned: 0 in 0.335s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:48 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 Jul 21 19:20:48 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:48 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5" returned: 0 in 0.348s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:48 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5 Jul 21 19:20:48 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:48 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:48 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad.b78dab6a-44b4-4775-8825-c7b4b3862ae5" returned: 0 in 0.273s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-b78dab6a-44b4-4775-8825-c7b4b3862ae5" released by "_delete_snapshot" :: held 1.429s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-871bc4a9-95a8-4649-9554-da4aaef997ad" released by "delete_snapshot" :: held 1.452s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:48 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Created reservations ['3db6be8f-9c5d-4e2f-8dee-87d101b7d005', 'ffaf18e2-4e4e-4e63-bffb-4a68acbd7c9c', 'baee88f1-84f7-422b-93c9-d67fcede76e2', 'c0ed11e9-dab5-4919-acbe-006de5ca14d2'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:48 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Delete snapshot completed successfully. Jul 21 19:20:48 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-a7ff70b6-7129-4c37-83c2-206005efb382 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-b78dab6a-44b4-4775-8825-c7b4b3862ae5-delete_snapshot" released by "delete_snapshot" :: held 1.593s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-871bc4a9-95a8-4649-9554-da4aaef997ad-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-871bc4a9-95a8-4649-9554-da4aaef997ad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:49 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:DELETE=19,cinder:SELECT=186,cinder:INSERT=67,cinder:UPDATE=237 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:20:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "cinder-quobyte-871bc4a9-95a8-4649-9554-da4aaef997ad" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:49 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-871bc4a9-95a8-4649-9554-da4aaef997ad" acquired by "delete_volume" :: waited 0.018s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:49 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b60b000-72b9-4a89-ab9d-05f037e44a1f]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:49 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad Jul 21 19:20:49 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:49 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad" returned: 0 in 0.357s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:49 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:49 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad Jul 21 19:20:49 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:50 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-871bc4a9-95a8-4649-9554-da4aaef997ad" returned: 0 in 0.236s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-quobyte-871bc4a9-95a8-4649-9554-da4aaef997ad" released by "delete_volume" :: held 0.652s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:50 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Created reservations ['312d32e3-c3aa-4485-ac55-2dc61c4abab8', '090b88a7-7b3f-4ebf-98f9-1ab819d6819a', '0a6a6073-50d0-41b7-b462-0abd2526ae8f', '9eb21d2e-ce26-4f2b-a4b6-a660da0cdd28'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:50 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:50 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:20:50 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:50 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:50 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.226s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:50 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:50 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Deleted volume successfully. Jul 21 19:20:50 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-6a714699-d5cc-4a6e-b1d6-1fa855c13ec6 tempest-ProjectMemberTests-1585065700 None] Lock "cinder-871bc4a9-95a8-4649-9554-da4aaef997ad-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:00 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=13,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:21:00 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Flow 'volume_create_manager' (6db62da6-ce90-4775-9b83-15c3b2d74728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e310021d-3f8d-45df-b010-66f32e50f629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e310021d-3f8d-45df-b010-66f32e50f629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1342582381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fda634-5a49-44ee-8d77-61eb4f793125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4b5f97bba44bd8a86d9d36b27dc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:21:21Z,use_quota=True,user_id='24b10805f19d4d9f9f5940ab1be38919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc84585-ee0d-435f-b424-42747ec06957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc84585-ee0d-435f-b424-42747ec06957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e14c24-95fa-4dd1-a877-f0a2c6e59717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e14c24-95fa-4dd1-a877-f0a2c6e59717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13fda634-5a49-44ee-8d77-61eb4f793125', 'volume_name': 'volume-13fda634-5a49-44ee-8d77-61eb4f793125', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94cc87b8-78e5-49af-ade0-242d845cfef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94cc87b8-78e5-49af-ade0-242d845cfef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f89c12-316c-4457-880b-0adfa30d49b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:21 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Volume 13fda634-5a49-44ee-8d77-61eb4f793125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13fda634-5a49-44ee-8d77-61eb4f793125', 'volume_size': 1} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1342582381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fda634-5a49-44ee-8d77-61eb4f793125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4b5f97bba44bd8a86d9d36b27dc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:21:21Z,use_quota=True,user_id='24b10805f19d4d9f9f5940ab1be38919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)}" {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Creating volume 13fda634-5a49-44ee-8d77-61eb4f793125 {{(pid=87487) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:21:21 devstack cinder-volume[87487]: INFO cinder.volume.drivers.remotefs [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] casted to osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 1073741824 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:21 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 1073741824 Jul 21 19:21:21 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:21 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 1073741824" returned: 0 in 0.401s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:21 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 Jul 21 19:21:21 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:21 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125" returned: 0 in 0.242s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'} {{(pid=87487) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f89c12-316c-4457-880b-0adfa30d49b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fda634-5a49-44ee-8d77-61eb4f793125', 'volume_size': 1}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2354fad9-fc47-44e1-b570-0c8d1ad0e5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:21 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Volume volume-13fda634-5a49-44ee-8d77-61eb4f793125 (13fda634-5a49-44ee-8d77-61eb4f793125): created successfully Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2354fad9-fc47-44e1-b570-0c8d1ad0e5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:21 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Flow 'volume_create_manager' (6db62da6-ce90-4775-9b83-15c3b2d74728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:21:21 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-3944a5ad-c953-4038-b8cf-6ad3a309e3c9 tempest-SnapshotDependencyTests-1388851521 None] Created volume successfully. Jul 21 19:21:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:22 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] Creating offline snapshot 0c8ada6e-e095-473e-a233-2931c515e055 of volume 13fda634-5a49-44ee-8d77-61eb4f793125 {{(pid=87487) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:21:22 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f484be37-6556-443d-b2d5-feeceb4e5ed5]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:22 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 Jul 21 19:21:22 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:22 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125" returned: 0 in 0.341s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:22 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 1G {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:22 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 1G Jul 21 19:21:22 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:23 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 1G" returned: 0 in 0.413s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13fda634-5a49-44ee-8d77-61eb4f793125 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:23 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13fda634-5a49-44ee-8d77-61eb4f793125 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 Jul 21 19:21:23 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:23 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13fda634-5a49-44ee-8d77-61eb4f793125 -F qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055" returned: 0 in 0.273s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:23 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 is being set with open permissions: ugo+rw Jul 21 19:21:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:23 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 Jul 21 19:21:23 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:23 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055" returned: 0 in 0.234s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:23 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.info Jul 21 19:21:23 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:23 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.info" returned: 0 in 0.245s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:23 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.info is being set with open permissions: ugo+rw Jul 21 19:21:23 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.info {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:23 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.info Jul 21 19:21:23 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:24 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.info" returned: 0 in 0.235s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:24 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-9bc8ce04-7f1d-46ed-b200-e2ca39dde0c8 tempest-SnapshotDependencyTests-1388851521 None] Create snapshot completed successfully Jul 21 19:21:24 devstack cinder-volume[87487]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87487) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:21:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Flow 'volume_create_manager' (4b936daa-b830-4a57-b0af-1f8f9bb0d313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:21:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e061eb8-7750-4aa3-bb2e-a769abd98432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e061eb8-7750-4aa3-bb2e-a769abd98432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f261b7ff-f46a-4762-a3d9-3bdd55757986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4b5f97bba44bd8a86d9d36b27dc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0c8ada6e-e095-473e-a233-2931c515e055,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:21:25Z,use_quota=True,user_id='24b10805f19d4d9f9f5940ab1be38919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f863a05-c00b-4338-b2b6-9e0d0362abc6),volume_type_id=1f863a05-c00b-4338-b2b6-9e0d0362abc6)' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be146ee0-7530-4a4d-9af6-b72275d42620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be146ee0-7530-4a4d-9af6-b72275d42620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092305a5-4e37-4488-8743-a224059ec44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092305a5-4e37-4488-8743-a224059ec44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f261b7ff-f46a-4762-a3d9-3bdd55757986', 'volume_name': 'volume-f261b7ff-f46a-4762-a3d9-3bdd55757986', 'volume_size': 1, 'snapshot_id': '0c8ada6e-e095-473e-a233-2931c515e055'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38cdfc1-7cf9-4eed-851b-7a3096e96918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38cdfc1-7cf9-4eed-851b-7a3096e96918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:24 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40aa75fa-6518-4a74-872f-a030f2ee49ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:24 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Volume f261b7ff-f46a-4762-a3d9-3bdd55757986: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f261b7ff-f46a-4762-a3d9-3bdd55757986', 'volume_size': 1, 'snapshot_id': '0c8ada6e-e095-473e-a233-2931c515e055'} Jul 21 19:21:24 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "cinder-quobyte-0c8ada6e-e095-473e-a233-2931c515e055-f261b7ff-f46a-4762-a3d9-3bdd55757986" by "_create_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-quobyte-0c8ada6e-e095-473e-a233-2931c515e055-f261b7ff-f46a-4762-a3d9-3bdd55757986" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Creating volume f261b7ff-f46a-4762-a3d9-3bdd55757986 from snapshot 0c8ada6e-e095-473e-a233-2931c515e055 {{(pid=87487) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Selected osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77 as target Quobyte volume. {{(pid=87487) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "cinder-quobyte-f261b7ff-f46a-4762-a3d9-3bdd55757986" by "_copy_volume_from_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-quobyte-f261b7ff-f46a-4762-a3d9-3bdd55757986" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] snapshot: 0c8ada6e-e095-473e-a233-2931c515e055, volume: f261b7ff-f46a-4762-a3d9-3bdd55757986, {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66bfad1-a914-4c0a-9187-416479a4ec4d]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:25 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 Jul 21 19:21:25 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:25 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055" returned: 0 in 0.332s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13fda634-5a49-44ee-8d77-61eb4f793125(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Creating direct copy from snapshot {{(pid=87487) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[7887f866-dff7-4c21-8f27-3e3de4bb8ebb]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:25 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 Jul 21 19:21:25 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:25 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125" returned: 0 in 0.348s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG cinder.utils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Path /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986 not found in is_blk_device check {{(pid=87487) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:21:25 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:25 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986 Jul 21 19:21:25 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:29 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986" returned: 0 in 3.837s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:29 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea7bb20-ad29-4550-9f3d-659451b31041]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:29 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:29 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 Jul 21 19:21:29 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:30 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125" returned: 0 in 0.507s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:30 devstack cinder-volume[87487]: DEBUG cinder.image.image_utils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125, size 1024.00 MB, duration 3.84 sec, destination /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986 {{(pid=87487) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:21:30 devstack cinder-volume[87487]: INFO cinder.image.image_utils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Converted 1024.00 MB image at 266.81 MB/s Jul 21 19:21:30 devstack cinder-volume[87487]: WARNING cinder.volume.drivers.remotefs [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986 is being set with open permissions: ugo+rw Jul 21 19:21:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:30 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986 Jul 21 19:21:30 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:30 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986" returned: 0 in 0.233s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-quobyte-f261b7ff-f46a-4762-a3d9-3bdd55757986" released by "_copy_volume_from_snapshot" :: held 5.339s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:30 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-quobyte-0c8ada6e-e095-473e-a233-2931c515e055-f261b7ff-f46a-4762-a3d9-3bdd55757986" released by "_create_volume_from_snapshot" :: held 5.370s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:30 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.388s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40aa75fa-6518-4a74-872f-a030f2ee49ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f261b7ff-f46a-4762-a3d9-3bdd55757986', 'volume_size': 1, 'snapshot_id': '0c8ada6e-e095-473e-a233-2931c515e055'}' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efaa5c02-3318-4450-93b0-a34be7f8d0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:30 devstack cinder-volume[87487]: INFO cinder.volume.flows.manager.create_volume [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Volume volume-f261b7ff-f46a-4762-a3d9-3bdd55757986 (f261b7ff-f46a-4762-a3d9-3bdd55757986): created successfully Jul 21 19:21:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efaa5c02-3318-4450-93b0-a34be7f8d0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87487) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:30 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Flow 'volume_create_manager' (4b936daa-b830-4a57-b0af-1f8f9bb0d313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87487) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:21:30 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-18d1cb93-d7c6-424c-bb3e-f97a60596e51 tempest-SnapshotDependencyTests-1388851521 None] Created volume successfully. Jul 21 19:21:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "cinder-0c8ada6e-e095-473e-a233-2931c515e055-delete_snapshot" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-0c8ada6e-e095-473e-a233-2931c515e055-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "cinder-quobyte-13fda634-5a49-44ee-8d77-61eb4f793125" by "delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-quobyte-13fda634-5a49-44ee-8d77-61eb4f793125" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "cinder-quobyte-0c8ada6e-e095-473e-a233-2931c515e055" by "_delete_snapshot" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:31 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-quobyte-0c8ada6e-e095-473e-a233-2931c515e055" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:31 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Deleting offline snapshot 0c8ada6e-e095-473e-a233-2931c515e055 of volume 13fda634-5a49-44ee-8d77-61eb4f793125 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:21:31 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] snapshot_file for this snap is: volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 {{(pid=87487) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:21:31 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b09a87-3da0-4992-99f2-25417a3aaab2]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:31 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 Jul 21 19:21:31 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:31 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055" returned: 0 in 0.350s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:31 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.remotefs [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13fda634-5a49-44ee-8d77-61eb4f793125(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87487) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:21:31 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[c471306c-bd50-421a-b263-ff664b204ecf]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:31 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:32 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 Jul 21 19:21:32 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:32 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125" returned: 0 in 0.345s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:32 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 Jul 21 19:21:32 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:32 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055" returned: 0 in 0.320s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:32 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055 Jul 21 19:21:32 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:32 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:32 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125.0c8ada6e-e095-473e-a233-2931c515e055" returned: 0 in 0.230s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-quobyte-0c8ada6e-e095-473e-a233-2931c515e055" released by "_delete_snapshot" :: held 1.334s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:32 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-quobyte-13fda634-5a49-44ee-8d77-61eb4f793125" released by "delete_snapshot" :: held 1.353s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:32 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Created reservations ['068400c7-fa3a-438b-90da-dbada8b43aae', '43940495-6f17-437f-b457-cad1dfe8130e', '6f058927-902d-42ae-a41c-9632d53f792f', '21c3fca4-f167-47d6-91a7-4b3c1c547bff'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:21:33 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Delete snapshot completed successfully. Jul 21 19:21:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-8d720c05-86b3-40f1-9a98-02d9476cab4f tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-0c8ada6e-e095-473e-a233-2931c515e055-delete_snapshot" released by "delete_snapshot" :: held 1.477s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "cinder-13fda634-5a49-44ee-8d77-61eb4f793125-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-13fda634-5a49-44ee-8d77-61eb4f793125-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "cinder-quobyte-13fda634-5a49-44ee-8d77-61eb4f793125" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:33 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-quobyte-13fda634-5a49-44ee-8d77-61eb4f793125" acquired by "delete_volume" :: waited 0.013s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:33 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[a807def9-cdfd-4a7f-be55-4831d5c0b243]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:33 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:33 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 Jul 21 19:21:33 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:34 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125" returned: 0 in 0.337s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:34 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125 Jul 21 19:21:34 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:34 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-13fda634-5a49-44ee-8d77-61eb4f793125" returned: 0 in 0.227s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-quobyte-13fda634-5a49-44ee-8d77-61eb4f793125" released by "delete_volume" :: held 0.619s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Created reservations ['3d64f11b-e5d0-48e8-899b-71d2437974e7', 'acfd2253-744e-4e8b-bcef-63b39aadafdb', '24ceaab2-5e7f-4d6c-82a5-86608fb9c813', '74d7156f-3b90-4572-a7fc-fd714c9bc12d'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:34 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:21:34 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:34 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.239s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:21:34 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Deleted volume successfully. Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-96101797-6443-45d3-b216-e560c86b7447 tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-13fda634-5a49-44ee-8d77-61eb4f793125-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "cinder-f261b7ff-f46a-4762-a3d9-3bdd55757986-delete_volume" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-f261b7ff-f46a-4762-a3d9-3bdd55757986-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "cinder-quobyte-f261b7ff-f46a-4762-a3d9-3bdd55757986" by "delete_volume" {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-quobyte-f261b7ff-f46a-4762-a3d9-3bdd55757986" acquired by "delete_volume" :: waited 0.015s {{(pid=87487) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a702093-368a-4d2d-9a56-7afc5545aa48]: (4, 'qcow2') {{(pid=88594) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:34 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:35 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986 Jul 21 19:21:35 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:35 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986" returned: 0 in 0.327s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986 {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:35 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986 Jul 21 19:21:35 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:35 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd/volume-f261b7ff-f46a-4762-a3d9-3bdd55757986" returned: 0 in 0.228s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-quobyte-f261b7ff-f46a-4762-a3d9-3bdd55757986" released by "delete_volume" :: held 0.593s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:35 devstack cinder-volume[87487]: DEBUG cinder.quota [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Created reservations ['4502dbab-aa99-41b8-b2bb-b5e83230f0e2', '4162c144-d7b8-4a70-8e72-8a22b54f7609', 'b2aeae0a-4718-465e-bbaa-b1cddfccb0f1', '0a0638c5-38cc-4270-b9a3-3402e1299efa'] {{(pid=87487) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:21:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:35 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:35 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:21:35 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:35 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:35 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.235s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:35 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:21:35 devstack cinder-volume[87487]: INFO cinder.volume.manager [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Deleted volume successfully. Jul 21 19:21:35 devstack cinder-volume[87487]: DEBUG cinder.coordination [None req-990c6656-be03-484a-8628-f801c27d3d95 tempest-SnapshotDependencyTests-1388851521 None] Lock "cinder-f261b7ff-f46a-4762-a3d9-3bdd55757986-delete_volume" released by "delete_volume" :: held 1.005s {{(pid=87487) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:21:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77': None} {{(pid=87487) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:40 devstack cinder-volume[87487]: DEBUG cinder.volume.drivers.quobyte [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32fa4a95-e862-47a9-b48f-32748f929e77'] {{(pid=87487) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.lockutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87487) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:40 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd Jul 21 19:21:40 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:40 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:40 devstack cinder-volume[87487]: DEBUG oslo_concurrency.processutils [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b10660954bbb210f0ae959c34eabccd" returned: 0 in 0.241s {{(pid=87487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:40 devstack cinder-volume[87487]: DEBUG cinder.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Notifying Schedulers of capabilities ... {{(pid=87487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:21:40 devstack cinder-volume[87487]: DEBUG oslo_service.periodic_task [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] Running periodic task VolumeManager._thread_info {{(pid=87487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:21:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread count: 28 {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:21:40 devstack cinder-volume[87487]: DEBUG cinder.volume.manager [None req-433536e6-5e11-4356-a24c-5ce2664a428d None None] thread info: [<_MainThread(MainThread, started 123883617218688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:21:45 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:UPDATE=27,cinder:SELECT=26,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:21:45 devstack cinder-volume[87487]: DEBUG dbcounter [-] [87487] Writing DB stats cinder:SELECT=21,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}